Apr 29 10:07:37 devstack cinder-volume[75448]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75448) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 10:07:37 devstack cinder-volume[75448]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75448) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 10:07:37 devstack cinder-volume[75448]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75448) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 10:07:38 devstack cinder-volume[75448]: INFO dbcounter [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Registered counter for database cinder
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_db.sqlalchemy.engines [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75448) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG dbcounter [-] [75448] Writer thread running {{(pid=75448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 10:07:38 devstack cinder-volume[75448]: INFO cinder.rpc [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 29 10:07:38 devstack cinder-volume[75448]: INFO cinder.rpc [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_db.sqlalchemy.engines [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75448) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 10:07:38 devstack cinder-volume[75448]: INFO cinder.volume.manager [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Determined volume DB was empty at startup.
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG cinder.volume.manager [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75448) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 29 10:07:38 devstack cinder-volume[75448]: INFO cinder.volume.manager [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 29 10:07:38 devstack cinder-volume[75448]: WARNING stevedore.named [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 10:07:38 devstack cinder-volume[75448]: WARNING castellan.key_manager [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 10:07:38 devstack cinder-volume[75448]: WARNING cinder.keymgr.conf_key_mgr [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG cinder.volume.drivers.lvm [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75448) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_concurrency.processutils [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_concurrency.processutils [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] CMD "cinder-rtstool verify" returned: 0 in 0.350s {{(pid=75448) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_db.sqlalchemy.engines [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75448) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 10:07:38 devstack cinder-volume[75448]: INFO cinder.rpc [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 29 10:07:38 devstack cinder-volume[75448]: INFO cinder.rpc [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 29 10:07:38 devstack cinder-volume[75448]: WARNING stevedore.named [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 10:07:38 devstack cinder-volume[75448]: WARNING castellan.key_manager [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 10:07:38 devstack cinder-volume[75448]: INFO cinder.volume.manager [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_db.sqlalchemy.engines [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75448) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 10:07:38 devstack cinder-volume[75448]: INFO oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Starting 1 workers
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Started child 75617 {{(pid=75448) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Full set of CONF: {{(pid=75448) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] ******************************************************************************** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Configuration options gathered from: {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] ================================================================================ {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] allow_availability_zone_fallback = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] allow_compression_on_image_upload = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] allowed_direct_url_schemes     = [] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] api_rate_limit                 = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] auth_strategy                  = keystone {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] az_cache_duration              = 3600 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_availability_zone      = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_host                   = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75617]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_name                   = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_stats_polling_interval = 60 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backup_api_class               = cinder.backup.api.API {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backup_name_template           = backup-%s {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backup_use_same_host           = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backup_use_temp_snapshot       = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] chap_password                  = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] chap_username                  =  {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cinder_internal_tenant_project_id = d63fad9617ea42b59c57271efaca6b00 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cinder_internal_tenant_user_id = 8e6ea5ae631d452b960c38b1ccde3cbf {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cloned_volume_same_az          = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cluster                        = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] compression_format             = gzip {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] config_dir                     = [] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] config_source                  = [] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] control_exchange               = openstack {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] debug                          = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] default_availability_zone      = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] default_group_type             = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] default_volume_type            = lvmdriver-1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] disk_geometry                  = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] driver_client_cert             = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] driver_client_cert_key         = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] driver_data_namespace          = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] driver_ssl_cert_path           = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] driver_ssl_cert_verify         = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] driver_use_ssl                 = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] enable_force_upload            = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] enable_new_services            = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] enable_unsupported_driver      = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] enforce_multipath_for_image_xfer = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] filter_function                = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance_api_insecure            = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance_api_servers             = ['http://192.168.122.77/image'] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance_api_ssl_compression     = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance_ca_certificates_file    = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance_certfile                = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance_keyfile                 = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance_num_retries             = 3 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance_request_timeout         = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] goodness_function              = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] graceful_shutdown_timeout      = 5 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] group_api_class                = cinder.group.api.API {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] host                           = devstack {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] image_compress_on_upload       = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] image_conversion_address_space_limit = 1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] image_conversion_cpu_limit     = 60 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] image_conversion_disable       = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] image_upload_use_cinder_backend = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] image_upload_use_internal_tenant = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] image_volume_cache_enabled     = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] image_volume_cache_max_count   = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] image_volume_cache_max_size_gb = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:38 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] init_host_max_objects_retrieval = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] iscsi_target_flags             =  {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] iscsi_write_cache              = on {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] iser_helper                    = tgtadm {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] iser_ip_address                = 192.168.122.77 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] iser_port                      = 3260 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] log_color                      = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] log_config_append              = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] log_dir                        = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] log_file                       = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] log_options                    = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] log_rotate_interval            = 1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] log_rotate_interval_type       = days {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] log_rotation_type              = none {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] max_age                        = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] max_logfile_count              = 30 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] max_logfile_size_mb            = 200 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] max_over_subscription_ratio    = 20.0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] message_reap_interval          = 86400 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] message_ttl                    = 2592000 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] migration_create_volume_timeout_secs = 300 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] monkey_patch                   = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] monkey_patch_modules           = [] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] my_ip                          = 192.168.122.77 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] no_snapshot_gb_quota           = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] num_iser_scan_tries            = 3 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] num_shell_tries                = 3 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] num_volume_device_scan_tries   = 3 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] nvmeof_conn_info_version       = 1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] nvmet_ns_id                    = 10 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] nvmet_port_id                  = 1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] osapi_max_limit                = 1000 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] osapi_volume_ext_list          = [] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] osapi_volume_listen_port       = 8776 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] osapi_volume_use_ssl           = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] osapi_volume_workers           = 2 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] per_volume_size_limit          = -1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] periodic_fuzzy_delay           = 60 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] periodic_interval              = 60 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] public_endpoint                = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] publish_errors                 = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] quota_backup_gigabytes         = 1000 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] quota_backups                  = 10 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] quota_gigabytes                = 1000 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] quota_groups                   = 10 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] quota_snapshots                = 10 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] quota_volumes                  = 10 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] rate_limit_burst               = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] rate_limit_except_level        = CRITICAL {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] rate_limit_interval            = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] reinit_driver_count            = 3 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] replication_device             = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] report_discard_supported       = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] report_interval                = 120 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] reservation_clean_interval     = 86400 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] reservation_expire             = 86400 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] reserved_image_namespaces      = [] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] reserved_percentage            = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] rpc_response_timeout           = 120 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] run_external_periodic_tasks    = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] scst_target_driver             = iscsi {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] scst_target_iqn_name           = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] service_down_time              = 720 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] shell_completion               = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] snapshot_name_template         = snapshot-%s {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] snapshot_same_host             = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] split_loggers                  = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] state_path                     = /opt/stack/data/cinder {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] storage_availability_zone      = nova {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] storage_protocol               = iSCSI {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] syslog_log_facility            = LOG_USER {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] target_helper                  = lioadm {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] target_ip_address              = 192.168.122.77 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] target_port                    = 3260 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] target_protocol                = iscsi {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] target_secondary_ip_addresses  = [] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] trace_flags                    = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] transport_url                  = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] until_refresh                  = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] use_chap_auth                  = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] use_default_quota_class        = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] use_journal                    = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] use_json                       = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] use_multipath_for_image_xfer   = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] use_stderr                     = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] use_syslog                     = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] verify_glance_signatures       = enabled {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack sudo[75625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] volume_api_class               = cinder.volume.api.API {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] volume_backend_name            = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] volume_clear                   = zero {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] volume_clear_ionice            = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] volume_clear_size              = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack sudo[75625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] volume_copy_bps_limit          = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] volume_dd_blocksize            = 1M {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] volume_name_template           = volume-%s {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] volume_service_inithost_offload = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] volume_usage_audit_period      = month {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75617]: INFO cinder.volume.manager [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] zoning_mode                    = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_concurrency.disable_process_locking = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.admin_password = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.admin_token = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.admin_user  = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.auth_port   = 35357 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.auth_protocol = https {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.auth_section = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.auth_type   = password {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.auth_uri    = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.auth_version = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.cache       = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.certfile    = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.identity_uri = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.include_service_catalog = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.insecure    = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.interface   = public {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.keyfile     = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_password =  {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcache_username =  {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.region_name = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.service_type = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.77/identity {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.backend                  = dogpile.cache.null {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.backend_argument         = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.backend_expiration_time  = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.config_prefix            = cache.oslo {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.debug_cache_backend      = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.enable_retry_client      = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.enable_socket_keepalive  = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.enabled                  = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.enforce_fips_mode        = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.expiration_time          = 600 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.hashclient_retry_attempts = 2 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.memcache_dead_retry      = 300 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.memcache_sasl_enabled    = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.password                 = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.proxies                  = [] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.redis_db                 = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.redis_server             = localhost:6379 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.retry_attempts           = 2 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.retry_delay              = 0.0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.socket_keepalive_count   = 1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.socket_keepalive_idle    = 1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.socket_keepalive_interval = 1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.socket_timeout           = 1.0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.tls_allowed_ciphers      = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.tls_cafile               = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.tls_certfile             = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.tls_enabled              = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.tls_keyfile              = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cache.username                 = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] coordination.backend_url       = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.asyncio_connection    = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.asyncio_slave_connection = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.backend               = sqlalchemy {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.connection            = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.connection_debug      = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.connection_parameters =  {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.connection_recycle_time = 3600 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.connection_trace      = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.db_inc_retry_interval = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.db_max_retries        = 20 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.db_max_retry_interval = 10 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.db_retry_interval     = 1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.max_overflow          = 50 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.max_pool_size         = 5 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.max_retries           = 10 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.mysql_wsrep_sync_wait = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.pool_timeout          = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.retry_interval        = 10 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.slave_connection      = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.sqlite_synchronous    = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.synchronous_reader    = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] database.use_db_reconnect      = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] profiler.connection_string     = messaging:// {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] profiler.enabled               = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] profiler.es_doc_type           = notification {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] profiler.es_scroll_size        = 10000 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] profiler.es_scroll_time        = 2m {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] profiler.filter_error_trace    = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] profiler.hmac_keys             = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] profiler.sentinel_service_name = mymaster {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] profiler.socket_timeout        = 0.1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] profiler.trace_requests        = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] profiler.trace_sqlalchemy      = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] profiler_jaeger.process_tags   = {} {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] profiler_jaeger.service_name_prefix = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] profiler_otlp.service_name_prefix = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_policy.enforce_new_defaults = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:39 devstack cinder-volume[75448]: WARNING oslo_config.cfg [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_policy.enforce_scope      = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_policy.policy_default_rule = default {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] privsep_osbrick.group          = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] privsep_osbrick.helper_command = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] privsep_osbrick.user           = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cinder_sys_admin.group         = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cinder_sys_admin.helper_command = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] cinder_sys_admin.user          = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] service_user.auth_section      = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] service_user.auth_type         = password {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] service_user.cafile            = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] service_user.certfile          = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] service_user.collect_timing    = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] service_user.insecure          = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] service_user.keyfile           = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] service_user.send_service_user_token = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] service_user.split_loggers     = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] service_user.timeout           = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance.auth_section            = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance.auth_type               = password {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance.certfile                = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance.collect_timing          = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance.insecure                = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance.keyfile                 = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance.region_name             = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance.split_loggers           = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] glance.timeout                 = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.backend_availability_zone = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.chap_password = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.chap_username =  {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.disk_geometry = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.driver_client_cert = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.driver_client_cert_key = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.driver_data_namespace = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.driver_use_ssl = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.extra_capabilities = {} {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.filter_function = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.goodness_function = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.iscsi_target_flags =  {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.iscsi_write_cache = on {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.iser_ip_address = 192.168.122.77 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.iser_port     = 3260 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.lvm_share_target = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.lvm_type      = auto {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.num_shell_tries = 3 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.replication_device = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.report_discard_supported = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.reserved_percentage = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.target_helper = tgtadm {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.target_ip_address = 192.168.122.77 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.target_port   = 3260 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.target_protocol = iscsi {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.trace_flags   = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.unique_fqdn_network = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.use_chap_auth = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.volume_backend_name = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.volume_clear  = zero {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.volume_clear_ionice = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.volume_clear_size = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_reports.file_event_handler = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_reports.log_dir           = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.backend_host       = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.chap_password      = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.chap_username      = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.disk_geometry      = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.driver_client_cert = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.extra_capabilities = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.filter_function    = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.goodness_function  = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.iser_helper        = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.iser_port          = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:39 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.lvm_type           = auto {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.replication_device = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.report_discard_supported = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.reserved_percentage = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.scst_target_driver = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack sudo[75625]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.storage_protocol   = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.target_ip_address  = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.target_port        = 3260 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.trace_flags        = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.volume_clear       = zero {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] lvmdriver-1.volumes_dir        = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack sudo[75707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack sudo[75707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_notifications.driver = [] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_notifications.retry = -1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] key_manager.fixed_key          = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.barbican_api_version  = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.barbican_endpoint     = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.barbican_endpoint_type = public {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.barbican_region_name  = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.cafile                = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.certfile              = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.collect_timing        = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.insecure              = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.keyfile               = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.number_of_retries     = 60 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.retry_delay           = 1 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.send_service_user_token = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.split_loggers         = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.timeout               = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.verify_ssl            = True {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican.verify_ssl_path       = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican_service_user.auth_section = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican_service_user.auth_type = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican_service_user.cafile   = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican_service_user.certfile = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican_service_user.collect_timing = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican_service_user.insecure = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican_service_user.keyfile  = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican_service_user.split_loggers = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] barbican_service_user.timeout  = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] vault.approle_role_id          = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] vault.approle_secret_id        = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] vault.kv_mountpoint            = secret {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] vault.kv_path                  = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] vault.kv_version               = 2 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] vault.namespace                = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] vault.root_token_id            = **** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] vault.ssl_ca_crt_file          = None {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] vault.timeout                  = 60.0 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] vault.use_ssl                  = False {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:07:40 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] ******************************************************************************** {{(pid=75448) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 29 10:07:40 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.811s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:40 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:40 devstack sudo[75707]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:40 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.672s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:40 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:07:40 devstack cinder-volume[75617]: INFO cinder.brick.local_dev.lvm [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 29 10:07:40 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:40 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:40 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:40 devstack sudo[75938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 10:07:40 devstack sudo[75938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:41 devstack sudo[75938]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:41 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:41 devstack cinder-volume[75617]: DEBUG cinder.brick.local_dev.lvm [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75617) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 29 10:07:41 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:41 devstack sudo[76112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 10:07:41 devstack sudo[76112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:42 devstack sudo[76112]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:42 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.403s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:42 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:42 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:42 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:42 devstack sudo[76382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 10:07:42 devstack sudo[76382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:43 devstack sudo[76382]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:43 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.805s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:43 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:43 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:43 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:43 devstack sudo[76396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 29 10:07:43 devstack sudo[76396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:44 devstack sudo[76396]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:44 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.623s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:44 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:44 devstack sudo[76405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 10:07:44 devstack sudo[76405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:44 devstack sudo[76405]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:44 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:44 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:44 devstack sudo[76410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 10:07:44 devstack sudo[76410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:45 devstack sudo[76410]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:45 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:45 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:45 devstack sudo[76413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 10:07:45 devstack sudo[76413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:46 devstack sudo[76413]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:46 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:46 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:46 devstack sudo[76418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 10:07:46 devstack sudo[76418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:47 devstack sudo[76418]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:47 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.775s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:47 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:47 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:47 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:47 devstack sudo[76426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 10:07:47 devstack sudo[76426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:48 devstack sudo[76426]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:48 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.926s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:48 devstack cinder-volume[75617]: INFO cinder.volume.drivers.lvm [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 29 10:07:48 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:48 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:48 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:48 devstack sudo[76436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 10:07:48 devstack sudo[76436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:48 devstack sudo[76436]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:48 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.747s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:48 devstack cinder-volume[75617]: DEBUG cinder.volume.drivers.lvm [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Updating volume stats {{(pid=75617) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 10:07:48 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:48 devstack sudo[76549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 10:07:48 devstack sudo[76549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:48 devstack cinder-volume[75448]: DEBUG dbcounter [-] [75448] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75448) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:07:49 devstack sudo[76549]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:49 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:49 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:49 devstack sudo[76690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 10:07:49 devstack sudo[76690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:50 devstack sudo[76690]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:50 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:50 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:50 devstack sudo[76694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 10:07:50 devstack sudo[76694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:50 devstack sudo[76694]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:50 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.609s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:50 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:50 devstack sudo[76700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 10:07:50 devstack sudo[76700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:51 devstack sudo[76700]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:51 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:51 devstack cinder-volume[75617]: INFO cinder.volume.driver [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Driver hasn't implemented _init_vendor_properties()
Apr 29 10:07:51 devstack cinder-volume[75617]: DEBUG cinder.volume.driver [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75617) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 29 10:07:51 devstack cinder-volume[75617]: DEBUG oslo_db.sqlalchemy.engines [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 10:07:51 devstack cinder-volume[75617]: DEBUG dbcounter [-] [75617] Writer thread running {{(pid=75617) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 10:07:51 devstack cinder-volume[75617]: DEBUG cinder.db.sqlalchemy.api [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Building query based on filter {{(pid=75617) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 29 10:07:51 devstack cinder-volume[75617]: DEBUG cinder.image.image_utils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75617) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 29 10:07:51 devstack cinder-volume[75617]: INFO cinder.keymgr.migration [None req-a0e98b98-d1bc-44da-abb3-7730c35265fa None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 29 10:07:51 devstack cinder-volume[75617]: DEBUG cinder.volume.drivers.lvm [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Updating volume stats {{(pid=75617) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 10:07:51 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:51 devstack sudo[76704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 10:07:51 devstack sudo[76704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:51 devstack sudo[76704]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:51 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:51 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:51 devstack sudo[76707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 10:07:51 devstack sudo[76707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:52 devstack sudo[76707]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:52 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:52 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:52 devstack sudo[76711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 10:07:52 devstack sudo[76711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:53 devstack sudo[76711]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:53 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.620s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:53 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:53 devstack sudo[76714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 10:07:53 devstack sudo[76714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:53 devstack sudo[76714]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:53 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:53 devstack cinder-volume[75617]: DEBUG cinder.manager [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Notifying Schedulers of capabilities ... {{(pid=75617) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:07:53 devstack cinder-volume[75617]: INFO cinder.volume.manager [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Driver initialization completed successfully.
Apr 29 10:07:53 devstack cinder-volume[75617]: INFO cinder.manager [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Initiating service 2 cleanup
Apr 29 10:07:53 devstack cinder-volume[75617]: INFO cinder.manager [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Service 2 cleanup completed.
Apr 29 10:07:53 devstack cinder-volume[75617]: DEBUG cinder.service [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Creating RPC server for service cinder-volume {{(pid=75617) start /opt/stack/cinder/cinder/service.py:231}}
Apr 29 10:07:53 devstack cinder-volume[75617]: DEBUG cinder.service [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75617) start /opt/stack/cinder/cinder/service.py:237}}
Apr 29 10:07:53 devstack cinder-volume[75617]: INFO cinder.volume.manager [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 29 10:07:53 devstack cinder-volume[75617]: DEBUG cinder.volume.drivers.lvm [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Updating volume stats {{(pid=75617) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 10:07:53 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:53 devstack sudo[76722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 10:07:53 devstack sudo[76722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:54 devstack sudo[76722]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:54 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:54 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:54 devstack sudo[76726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 10:07:54 devstack sudo[76726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:55 devstack sudo[76726]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:55 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:55 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:55 devstack sudo[76729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 10:07:55 devstack sudo[76729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:55 devstack sudo[76729]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:55 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.614s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:55 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:07:55 devstack sudo[76786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 10:07:55 devstack sudo[76786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:07:56 devstack sudo[76786]: pam_unix(sudo:session): session closed for user root
Apr 29 10:07:56 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:07:56 devstack cinder-volume[75617]: INFO cinder.volume.manager [None req-3db00491-dde9-40f6-8997-92cdb82a13cc None None] Driver post RPC initialization completed successfully.
Apr 29 10:08:06 devstack cinder-volume[75617]: DEBUG dbcounter [-] [75617] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75617) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:08:06 devstack cinder-volume[75617]: DEBUG dbcounter [-] [75617] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75617) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:09:13 devstack cinder-volume[75617]: DEBUG oslo_service.periodic_task [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75617) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:09:13 devstack cinder-volume[75617]: DEBUG cinder.volume.drivers.lvm [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] Updating volume stats {{(pid=75617) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 10:09:13 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:09:13 devstack sudo[80972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 10:09:13 devstack sudo[80972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:09:14 devstack sudo[80972]: pam_unix(sudo:session): session closed for user root
Apr 29 10:09:14 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:09:14 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:09:14 devstack sudo[81317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 10:09:14 devstack sudo[81317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:09:14 devstack sudo[81317]: pam_unix(sudo:session): session closed for user root
Apr 29 10:09:14 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:09:14 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:09:14 devstack sudo[81459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 10:09:14 devstack sudo[81459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:09:15 devstack sudo[81459]: pam_unix(sudo:session): session closed for user root
Apr 29 10:09:15 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.603s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:09:15 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:09:15 devstack sudo[81487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 10:09:15 devstack sudo[81487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:09:15 devstack sudo[81487]: pam_unix(sudo:session): session closed for user root
Apr 29 10:09:15 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:09:15 devstack cinder-volume[75617]: DEBUG cinder.manager [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] Notifying Schedulers of capabilities ... {{(pid=75617) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:10:06 devstack cinder-volume[75617]: DEBUG dbcounter [-] [75617] Writing DB stats cinder:SELECT=1 {{(pid=75617) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:10:06 devstack cinder-volume[75617]: DEBUG dbcounter [-] [75617] Writing DB stats cinder:UPDATE=1 {{(pid=75617) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:10:13 devstack cinder-volume[75617]: DEBUG oslo_service.periodic_task [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75617) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:10:13 devstack cinder-volume[75617]: DEBUG cinder.volume.drivers.lvm [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] Updating volume stats {{(pid=75617) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 10:10:13 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:10:13 devstack sudo[81915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 10:10:13 devstack sudo[81915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:10:14 devstack sudo[81915]: pam_unix(sudo:session): session closed for user root
Apr 29 10:10:14 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:10:14 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:10:14 devstack sudo[81918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 10:10:14 devstack sudo[81918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:10:14 devstack sudo[81918]: pam_unix(sudo:session): session closed for user root
Apr 29 10:10:14 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:10:14 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:10:14 devstack sudo[81921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 10:10:14 devstack sudo[81921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:10:15 devstack sudo[81921]: pam_unix(sudo:session): session closed for user root
Apr 29 10:10:15 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.578s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:10:15 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:10:15 devstack sudo[81924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 10:10:15 devstack sudo[81924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:10:15 devstack sudo[81924]: pam_unix(sudo:session): session closed for user root
Apr 29 10:10:15 devstack cinder-volume[75617]: DEBUG oslo_concurrency.processutils [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.566s {{(pid=75617) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:10:15 devstack cinder-volume[75617]: DEBUG cinder.manager [None req-9f36d785-a16f-4963-900b-eeec0bfd5463 None None] Notifying Schedulers of capabilities ... {{(pid=75617) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:10:44 devstack cinder-volume[75448]: INFO oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Caught SIGTERM, stopping children
Apr 29 10:10:44 devstack cinder-volume[75448]: DEBUG oslo_concurrency.lockutils [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Acquiring lock "singleton_lock" {{(pid=75448) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 10:10:44 devstack cinder-volume[75448]: DEBUG oslo_concurrency.lockutils [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Acquired lock "singleton_lock" {{(pid=75448) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 10:10:44 devstack cinder-volume[75448]: DEBUG oslo_concurrency.lockutils [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Releasing lock "singleton_lock" {{(pid=75448) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 10:10:44 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Stop services. {{(pid=75448) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 29 10:10:44 devstack cinder-volume[75448]: DEBUG oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Killing children. {{(pid=75448) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 29 10:10:44 devstack cinder-volume[75448]: INFO oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Waiting on 1 children to exit
Apr 29 10:10:48 devstack cinder-volume[75617]: DEBUG oslo_concurrency.lockutils [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Acquiring lock "singleton_lock" {{(pid=75617) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 10:10:48 devstack cinder-volume[75617]: DEBUG oslo_concurrency.lockutils [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Acquired lock "singleton_lock" {{(pid=75617) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 10:10:48 devstack cinder-volume[75617]: DEBUG oslo_concurrency.lockutils [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Releasing lock "singleton_lock" {{(pid=75617) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 10:10:48 devstack cinder-volume[75617]: WARNING amqp [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 10:10:48 devstack cinder-volume[75617]: WARNING amqp [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 10:10:48 devstack cinder-volume[75448]: INFO oslo_service.backend._eventlet.service [None req-5faa52ec-1e02-4089-a3ff-47b02c454331 None None] Child 75617 exited with status 0
Apr 29 10:10:51 devstack cinder-volume[83319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 10:10:51 devstack cinder-volume[83319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 10:10:51 devstack cinder-volume[83319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 10:10:52 devstack cinder-volume[83319]: INFO dbcounter [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Registered counter for database cinder
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_db.sqlalchemy.engines [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG dbcounter [-] [83319] Writer thread running {{(pid=83319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 10:10:52 devstack cinder-volume[83319]: INFO cinder.rpc [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 29 10:10:52 devstack cinder-volume[83319]: INFO cinder.rpc [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_db.sqlalchemy.engines [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 10:10:52 devstack cinder-volume[83319]: INFO cinder.volume.manager [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Determined volume DB was empty at startup.
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG cinder.volume.manager [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83319) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 29 10:10:52 devstack cinder-volume[83319]: INFO cinder.volume.manager [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 29 10:10:52 devstack cinder-volume[83319]: WARNING stevedore.named [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 10:10:52 devstack cinder-volume[83319]: WARNING castellan.key_manager [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 10:10:52 devstack cinder-volume[83319]: WARNING cinder.keymgr.conf_key_mgr [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 10:10:52 devstack cinder-volume[83319]: INFO cinder.volume.manager [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_db.sqlalchemy.engines [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 10:10:52 devstack cinder-volume[83319]: INFO oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Starting 1 workers
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Started child 83612 {{(pid=83319) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Full set of CONF: {{(pid=83319) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] ******************************************************************************** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Configuration options gathered from: {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] ================================================================================ {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] allow_availability_zone_fallback = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] allow_compression_on_image_upload = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] allowed_direct_url_schemes     = [] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] api_rate_limit                 = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] auth_strategy                  = keystone {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_availability_zone      = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_host                   = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_name                   = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_stats_polling_interval = 60 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backup_api_class               = cinder.backup.api.API {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backup_name_template           = backup-%s {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backup_use_same_host           = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backup_use_temp_snapshot       = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] chap_password                  = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] chap_username                  =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cinder_internal_tenant_project_id = d63fad9617ea42b59c57271efaca6b00 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83612]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cinder_internal_tenant_user_id = 8e6ea5ae631d452b960c38b1ccde3cbf {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cluster                        = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] compression_format             = gzip {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] compute_api_class              = cinder.compute.nova.API {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] config_dir                     = [] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] config_source                  = [] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] control_exchange               = openstack {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] debug                          = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] default_availability_zone      = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] default_group_type             = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] default_volume_type            = QuobyteHD {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] disk_geometry                  = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] driver_client_cert             = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] driver_client_cert_key         = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] driver_data_namespace          = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] driver_ssl_cert_path           = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] driver_ssl_cert_verify         = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] driver_use_ssl                 = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] enable_new_services            = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] enable_unsupported_driver      = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] enabled_backends               = ['QuobyteHD'] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] enforce_multipath_for_image_xfer = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] filter_function                = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance_api_insecure            = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance_api_servers             = ['http://192.168.122.77/image'] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance_api_ssl_compression     = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance_ca_certificates_file    = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance_catalog_info            = image:glance:publicURL {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance_certfile                = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance_keyfile                 = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance_num_retries             = 3 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance_request_timeout         = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] goodness_function              = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] graceful_shutdown_timeout      = 5 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] group_api_class                = cinder.group.api.API {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] host                           = devstack {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] image_compress_on_upload       = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] image_conversion_address_space_limit = 1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] image_conversion_cpu_limit     = 60 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] image_conversion_disable       = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] image_upload_use_cinder_backend = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] image_upload_use_internal_tenant = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] image_volume_cache_enabled     = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] image_volume_cache_max_count   = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] image_volume_cache_max_size_gb = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] init_host_max_objects_retrieval = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] instance_format                = [instance: %(uuid)s]  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] iscsi_target_flags             =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] iscsi_write_cache              = on {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] iser_helper                    = tgtadm {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] iser_ip_address                = 192.168.122.77 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] iser_port                      = 3260 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] log_color                      = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] log_config_append              = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] log_dir                        = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] log_file                       = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] log_options                    = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] log_rotate_interval            = 1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] log_rotate_interval_type       = days {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] log_rotation_type              = none {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] max_age                        = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] max_logfile_count              = 30 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] max_logfile_size_mb            = 200 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] max_over_subscription_ratio    = 20.0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] message_reap_interval          = 86400 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] message_ttl                    = 2592000 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] migration_create_volume_timeout_secs = 300 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] monkey_patch                   = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] monkey_patch_modules           = [] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] my_ip                          = 192.168.122.77 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] no_snapshot_gb_quota           = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83612]: INFO cinder.volume.manager [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] num_iser_scan_tries            = 3 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83612]: DEBUG cinder.volume.drivers.remotefs [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83612) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] num_shell_tries                = 3 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] num_volume_device_scan_tries   = 3 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] nvmeof_conn_info_version       = 1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] nvmet_ns_id                    = 10 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] nvmet_port_id                  = 1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] osapi_max_limit                = 1000 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] osapi_volume_ext_list          = [] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] osapi_volume_listen_port       = 8776 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] osapi_volume_use_ssl           = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] osapi_volume_workers           = 2 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] per_volume_size_limit          = -1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] periodic_fuzzy_delay           = 60 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] periodic_interval              = 60 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] public_endpoint                = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] publish_errors                 = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] quota_backup_gigabytes         = 1000 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] quota_backups                  = 10 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] quota_gigabytes                = 1000 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] quota_groups                   = 10 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] quota_snapshots                = 10 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] quota_volumes                  = 10 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] rate_limit_burst               = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] rate_limit_except_level        = CRITICAL {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] rate_limit_interval            = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] reinit_driver_count            = 3 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] replication_device             = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] report_discard_supported       = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] report_interval                = 120 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] reservation_clean_interval     = 86400 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] reservation_expire             = 86400 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] reserved_image_namespaces      = [] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] reserved_percentage            = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] rpc_response_timeout           = 120 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] run_external_periodic_tasks    = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] scst_target_driver             = iscsi {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] scst_target_iqn_name           = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] service_down_time              = 720 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] shell_completion               = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] snapshot_name_template         = snapshot-%s {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] split_loggers                  = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] state_path                     = /opt/stack/data/cinder {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] storage_availability_zone      = nova {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] storage_protocol               = iSCSI {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] syslog_log_facility            = LOG_USER {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] target_helper                  = lioadm {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] target_ip_address              = 192.168.122.77 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] target_port                    = 3260 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] target_protocol                = iscsi {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] target_secondary_ip_addresses  = [] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] trace_flags                    = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] transport_url                  = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] until_refresh                  = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] use_chap_auth                  = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] use_default_quota_class        = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] use_journal                    = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] use_json                       = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] use_multipath_for_image_xfer   = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] use_stderr                     = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] use_syslog                     = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] verify_glance_signatures       = enabled {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] volume_api_class               = cinder.volume.api.API {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] volume_backend_name            = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] volume_clear                   = zero {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] volume_clear_ionice            = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] volume_clear_size              = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] volume_copy_bps_limit          = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] volume_dd_blocksize            = 1M {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] volume_name_template           = volume-%s {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] volume_service_inithost_offload = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] volume_usage_audit_period      = month {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] zoning_mode                    = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_concurrency.disable_process_locking = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.admin_password = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.admin_token = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.admin_user  = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.auth_port   = 35357 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.auth_protocol = https {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.auth_section = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.auth_type   = password {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.auth_uri    = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.auth_version = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.cache       = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.certfile    = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.identity_uri = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.include_service_catalog = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.insecure    = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.interface   = public {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.keyfile     = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_password =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcache_username =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.region_name = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:52 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.service_type = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.77/identity {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.backend                  = dogpile.cache.null {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.backend_argument         = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.backend_expiration_time  = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.config_prefix            = cache.oslo {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.debug_cache_backend      = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.enable_retry_client      = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.enable_socket_keepalive  = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.enabled                  = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.enforce_fips_mode        = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.expiration_time          = 600 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.hashclient_retry_attempts = 2 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.memcache_dead_retry      = 300 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.memcache_pool_maxsize    = 10 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.memcache_sasl_enabled    = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.password                 = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.proxies                  = [] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.redis_db                 = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.redis_server             = localhost:6379 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.retry_attempts           = 2 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.retry_delay              = 0.0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.socket_keepalive_count   = 1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.socket_keepalive_idle    = 1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.socket_keepalive_interval = 1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.socket_timeout           = 1.0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.tls_allowed_ciphers      = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.tls_cafile               = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.tls_certfile             = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.tls_enabled              = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.tls_keyfile              = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cache.username                 = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] coordination.backend_url       = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.asyncio_connection    = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.asyncio_slave_connection = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.backend               = sqlalchemy {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.connection            = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.connection_debug      = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.connection_parameters =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.connection_recycle_time = 3600 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.connection_trace      = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.db_inc_retry_interval = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.db_max_retries        = 20 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.db_max_retry_interval = 10 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.db_retry_interval     = 1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.max_overflow          = 50 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.max_pool_size         = 5 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.max_retries           = 10 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.mysql_wsrep_sync_wait = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.pool_timeout          = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.retry_interval        = 10 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.slave_connection      = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.sqlite_synchronous    = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.synchronous_reader    = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] database.use_db_reconnect      = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] profiler.connection_string     = messaging:// {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] profiler.enabled               = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] profiler.es_doc_type           = notification {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] profiler.es_scroll_size        = 10000 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] profiler.es_scroll_time        = 2m {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] profiler.filter_error_trace    = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] profiler.hmac_keys             = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] profiler.sentinel_service_name = mymaster {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] profiler.socket_timeout        = 0.1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] profiler.trace_requests        = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] profiler.trace_sqlalchemy      = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] profiler_jaeger.process_tags   = {} {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] profiler_jaeger.service_name_prefix = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] profiler_otlp.service_name_prefix = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_policy.enforce_new_defaults = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: WARNING oslo_config.cfg [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_policy.enforce_scope      = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_policy.policy_default_rule = default {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_policy.policy_file        = policy.yaml {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] privsep_osbrick.group          = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] privsep_osbrick.helper_command = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] privsep_osbrick.user           = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cinder_sys_admin.group         = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cinder_sys_admin.helper_command = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] cinder_sys_admin.user          = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] service_user.auth_section      = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] service_user.auth_type         = password {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] service_user.cafile            = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] service_user.certfile          = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] service_user.collect_timing    = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] service_user.insecure          = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] service_user.keyfile           = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] service_user.send_service_user_token = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] service_user.split_loggers     = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] service_user.timeout           = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance.auth_section            = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance.auth_type               = password {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance.certfile                = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance.collect_timing          = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance.insecure                = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance.keyfile                 = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance.region_name             = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance.split_loggers           = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] glance.timeout                 = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.backend_availability_zone = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.chap_password = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.chap_username =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.disk_geometry = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.driver_client_cert = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.driver_client_cert_key = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.driver_data_namespace = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.driver_use_ssl = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.extra_capabilities = {} {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.filter_function = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.goodness_function = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.iscsi_target_flags =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.iscsi_write_cache = on {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.iser_helper   = tgtadm {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.iser_ip_address = 192.168.122.77 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.iser_port     = 3260 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.nas_host      =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.nas_login     = admin {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.nas_mount_options = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.nas_password  = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.nas_private_key =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83612]: DEBUG cinder.volume.drivers.quobyte [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83612) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 29 10:10:53 devstack cinder-volume[83612]: WARNING cinder.volume.drivers.quobyte [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 29 10:10:53 devstack cinder-volume[83612]: WARNING cinder.volume.drivers.quobyte [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 29 10:10:53 devstack cinder-volume[83612]: DEBUG oslo_concurrency.processutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Running cmd (subprocess): mount.quobyte {{(pid=83612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.nas_share_path =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.num_shell_tries = 3 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.quobyte_volume_url = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.replication_device = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.report_discard_supported = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.reserved_percentage = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.target_helper = tgtadm {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.target_ip_address = 192.168.122.77 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.target_port   = 3260 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.target_protocol = iscsi {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.trace_flags   = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.unique_fqdn_network = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.use_chap_auth = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.volume_backend_name = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.volume_clear  = zero {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.volume_clear_ionice = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.volume_clear_size = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_reports.file_event_handler = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_reports.log_dir           = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.backend_availability_zone = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.backend_host         = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.chap_password        = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.chap_username        = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.chiscsi_conf         = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.disk_geometry        = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.driver_client_cert   = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.driver_data_namespace = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.driver_use_ssl       = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.extra_capabilities   = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.filter_function      = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.goodness_function    = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.iser_helper          = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.iser_ip_address      = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.iser_port            = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.iser_target_prefix   = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.nas_host             = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.nas_login            = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.nas_mount_options    = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.nas_password         = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.nas_private_key      = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.nas_share_path       = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.nas_ssh_port         = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.num_shell_tries      = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.nvmet_port_id        = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.replication_device   = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.report_discard_supported = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.reserved_percentage  = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.scst_target_driver   = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.storage_protocol     = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.target_helper        = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.target_ip_address    = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.target_port          = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.target_prefix        = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.target_protocol      = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.trace_flags          = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.use_chap_auth        = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.volume_clear         = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.volume_clear_size    = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] QuobyteHD.volumes_dir          = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.ssl      = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_notifications.driver = [] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_notifications.retry = -1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] key_manager.fixed_key          = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.barbican_api_version  = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.barbican_endpoint     = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.barbican_endpoint_type = public {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.barbican_region_name  = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.cafile                = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.certfile              = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.collect_timing        = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.insecure              = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.keyfile               = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.number_of_retries     = 60 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.retry_delay           = 1 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.send_service_user_token = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.split_loggers         = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.timeout               = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.verify_ssl            = True {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican.verify_ssl_path       = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican_service_user.auth_section = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican_service_user.auth_type = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican_service_user.cafile   = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican_service_user.certfile = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican_service_user.collect_timing = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican_service_user.insecure = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican_service_user.keyfile  = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican_service_user.split_loggers = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] barbican_service_user.timeout  = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] vault.approle_role_id          = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] vault.approle_secret_id        = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] vault.kv_mountpoint            = secret {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] vault.kv_path                  = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] vault.kv_version               = 2 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] vault.namespace                = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] vault.root_token_id            = **** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] vault.ssl_ca_crt_file          = None {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] vault.timeout                  = 60.0 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] vault.use_ssl                  = False {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:10:53 devstack quobyte-client[83617]: Reading configuration file: /etc/quobyte/client.cfg
Apr 29 10:10:53 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] ******************************************************************************** {{(pid=83319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 29 10:10:53 devstack quobyte-client[83617]: Invalid parameters found, error: missing mount point.
Apr 29 10:10:53 devstack quobyte-client[83617]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 29 10:10:53 devstack quobyte-client[83617]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 29 10:10:53 devstack cinder-volume[83612]: DEBUG oslo_concurrency.processutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] CMD "mount.quobyte" returned: 1 in 0.121s {{(pid=83612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:10:53 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:10:53 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:10:53 devstack cinder-volume[83612]: DEBUG cinder.volume.drivers.quobyte [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=83612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:10:53 devstack cinder-volume[83612]: INFO cinder.volume.drivers.quobyte [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c ...
Apr 29 10:10:53 devstack cinder-volume[83612]: DEBUG oslo_concurrency.processutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 -c /etc/quobyte/client-cinder.cfg {{(pid=83612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:10:53 devstack sudo[83618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 -c /etc/quobyte/client-cinder.cfg
Apr 29 10:10:53 devstack sudo[83618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:10:53 devstack sudo[83618]: pam_unix(sudo:session): session closed for user root
Apr 29 10:10:53 devstack cinder-volume[83612]: DEBUG oslo_concurrency.processutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.778s {{(pid=83612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:10:53 devstack cinder-volume[83612]: INFO cinder.volume.drivers.quobyte [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c succeeded
Apr 29 10:10:53 devstack cinder-volume[83612]: DEBUG cinder.volume.drivers.quobyte [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=83612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:10:53 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.806s {{(pid=83612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:10:53 devstack cinder-volume[83612]: DEBUG oslo_concurrency.processutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=83612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:10:54 devstack sudo[83687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:10:54 devstack sudo[83687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:10:54 devstack sudo[83687]: pam_unix(sudo:session): session closed for user root
Apr 29 10:10:54 devstack cinder-volume[83612]: DEBUG oslo_concurrency.processutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.631s {{(pid=83612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:10:54 devstack cinder-volume[83612]: INFO cinder.volume.driver [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Driver hasn't implemented _init_vendor_properties()
Apr 29 10:10:54 devstack cinder-volume[83612]: DEBUG cinder.volume.driver [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327003479004, 'free_capacity_gb': 1775.7327003479004, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83612) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 29 10:10:54 devstack cinder-volume[83612]: DEBUG oslo_db.sqlalchemy.engines [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83612) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 10:10:54 devstack cinder-volume[83612]: DEBUG dbcounter [-] [83612] Writer thread running {{(pid=83612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 10:10:54 devstack cinder-volume[83612]: DEBUG cinder.db.sqlalchemy.api [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Building query based on filter {{(pid=83612) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 29 10:10:54 devstack cinder-volume[83612]: DEBUG cinder.image.image_utils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83612) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 29 10:10:54 devstack cinder-volume[83612]: INFO cinder.keymgr.migration [None req-efc1e518-6466-4b06-a6bf-f4ce9568cc69 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 29 10:10:54 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:10:54 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:10:54 devstack cinder-volume[83612]: DEBUG cinder.volume.drivers.quobyte [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=83612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:10:54 devstack cinder-volume[83612]: DEBUG cinder.volume.drivers.quobyte [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=83612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:10:54 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:10:54 devstack cinder-volume[83612]: DEBUG oslo_concurrency.processutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=83612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:10:54 devstack sudo[83693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:10:54 devstack sudo[83693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:10:55 devstack sudo[83693]: pam_unix(sudo:session): session closed for user root
Apr 29 10:10:55 devstack cinder-volume[83612]: DEBUG oslo_concurrency.processutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.692s {{(pid=83612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:10:55 devstack cinder-volume[83612]: DEBUG cinder.manager [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Notifying Schedulers of capabilities ... {{(pid=83612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:10:55 devstack cinder-volume[83612]: INFO cinder.volume.manager [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Driver initialization completed successfully.
Apr 29 10:10:55 devstack cinder-volume[83612]: INFO cinder.manager [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Initiating service 3 cleanup
Apr 29 10:10:55 devstack cinder-volume[83612]: INFO cinder.manager [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Service 3 cleanup completed.
Apr 29 10:10:55 devstack cinder-volume[83612]: DEBUG cinder.service [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Creating RPC server for service cinder-volume {{(pid=83612) start /opt/stack/cinder/cinder/service.py:231}}
Apr 29 10:10:55 devstack cinder-volume[83612]: DEBUG cinder.service [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83612) start /opt/stack/cinder/cinder/service.py:237}}
Apr 29 10:10:55 devstack cinder-volume[83612]: INFO cinder.volume.manager [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 29 10:10:55 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:10:55 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:10:55 devstack cinder-volume[83612]: DEBUG cinder.volume.drivers.quobyte [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=83612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:10:55 devstack cinder-volume[83612]: DEBUG cinder.volume.drivers.quobyte [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=83612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:10:55 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:10:55 devstack cinder-volume[83612]: DEBUG oslo_concurrency.processutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=83612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:10:55 devstack sudo[83775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:10:55 devstack sudo[83775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:10:56 devstack sudo[83775]: pam_unix(sudo:session): session closed for user root
Apr 29 10:10:56 devstack cinder-volume[83612]: DEBUG oslo_concurrency.processutils [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.897s {{(pid=83612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:10:56 devstack cinder-volume[83612]: INFO cinder.volume.manager [None req-ba6fe690-e422-49b0-a5ee-dd2262e92396 None None] Driver post RPC initialization completed successfully.
Apr 29 10:10:58 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-eaf63ad6-a177-4344-9aef-5a2b14a2ae03 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:10:58 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-eaf63ad6-a177-4344-9aef-5a2b14a2ae03 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:10:58 devstack cinder-volume[83612]: DEBUG cinder.volume.drivers.quobyte [None req-eaf63ad6-a177-4344-9aef-5a2b14a2ae03 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=83612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:10:58 devstack cinder-volume[83612]: DEBUG cinder.volume.drivers.quobyte [None req-eaf63ad6-a177-4344-9aef-5a2b14a2ae03 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=83612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:10:58 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-eaf63ad6-a177-4344-9aef-5a2b14a2ae03 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:10:58 devstack cinder-volume[83612]: DEBUG oslo_concurrency.processutils [None req-eaf63ad6-a177-4344-9aef-5a2b14a2ae03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=83612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:10:58 devstack sudo[83810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:10:58 devstack sudo[83810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:10:59 devstack sudo[83810]: pam_unix(sudo:session): session closed for user root
Apr 29 10:10:59 devstack cinder-volume[83612]: DEBUG oslo_concurrency.processutils [None req-eaf63ad6-a177-4344-9aef-5a2b14a2ae03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.579s {{(pid=83612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:10:59 devstack cinder-volume[83612]: DEBUG cinder.manager [None req-eaf63ad6-a177-4344-9aef-5a2b14a2ae03 None None] Notifying Schedulers of capabilities ... {{(pid=83612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:10:59 devstack cinder-volume[83319]: INFO oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Caught SIGTERM, stopping children
Apr 29 10:10:59 devstack cinder-volume[83319]: DEBUG oslo_concurrency.lockutils [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Acquiring lock "singleton_lock" {{(pid=83319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 10:10:59 devstack cinder-volume[83319]: DEBUG oslo_concurrency.lockutils [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Acquired lock "singleton_lock" {{(pid=83319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 10:10:59 devstack cinder-volume[83319]: DEBUG oslo_concurrency.lockutils [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Releasing lock "singleton_lock" {{(pid=83319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 10:10:59 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Stop services. {{(pid=83319) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 29 10:10:59 devstack cinder-volume[83319]: DEBUG oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Killing children. {{(pid=83319) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 29 10:10:59 devstack cinder-volume[83319]: INFO oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Waiting on 1 children to exit
Apr 29 10:11:03 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Acquiring lock "singleton_lock" {{(pid=83612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 10:11:03 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Acquired lock "singleton_lock" {{(pid=83612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 10:11:03 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Releasing lock "singleton_lock" {{(pid=83612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 10:11:04 devstack cinder-volume[83612]: WARNING amqp [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 10:11:04 devstack cinder-volume[83612]: WARNING amqp [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 10:11:04 devstack cinder-volume[83319]: INFO oslo_service.backend._eventlet.service [None req-3907cab9-ec45-4169-a4b3-2cd59e0ff097 None None] Child 83612 exited with status 0
Apr 29 10:11:07 devstack cinder-volume[83919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83919) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 10:11:07 devstack cinder-volume[83919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83919) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 10:11:07 devstack cinder-volume[83919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83919) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 10:11:07 devstack cinder-volume[83919]: INFO dbcounter [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] Registered counter for database cinder
Apr 29 10:11:07 devstack cinder-volume[83919]: DEBUG oslo_db.sqlalchemy.engines [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83919) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG dbcounter [-] [83919] Writer thread running {{(pid=83919) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 10:11:08 devstack cinder-volume[83919]: INFO cinder.rpc [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 29 10:11:08 devstack cinder-volume[83919]: INFO cinder.rpc [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_db.sqlalchemy.engines [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83919) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 10:11:08 devstack cinder-volume[83919]: INFO cinder.volume.manager [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] Determined volume DB was empty at startup.
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG cinder.volume.manager [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83919) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 29 10:11:08 devstack cinder-volume[83919]: WARNING stevedore.named [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 10:11:08 devstack cinder-volume[83919]: WARNING castellan.key_manager [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 10:11:08 devstack cinder-volume[83919]: WARNING cinder.keymgr.conf_key_mgr [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 10:11:08 devstack cinder-volume[83919]: INFO cinder.volume.manager [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_db.sqlalchemy.engines [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83919) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 10:11:08 devstack cinder-volume[83919]: INFO oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] Starting 1 workers
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] Started child 84165 {{(pid=83919) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] Full set of CONF: {{(pid=83919) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] ******************************************************************************** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] Configuration options gathered from: {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] ================================================================================ {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] allow_availability_zone_fallback = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] allow_compression_on_image_upload = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] allowed_direct_url_schemes     = [] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] api_rate_limit                 = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] auth_strategy                  = keystone {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_availability_zone      = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_host                   = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_name                   = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_stats_polling_interval = 60 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backup_api_class               = cinder.backup.api.API {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[84165]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backup_name_template           = backup-%s {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backup_use_same_host           = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backup_use_temp_snapshot       = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] chap_password                  = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] chap_username                  =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cinder_internal_tenant_project_id = d63fad9617ea42b59c57271efaca6b00 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cinder_internal_tenant_user_id = 8e6ea5ae631d452b960c38b1ccde3cbf {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cluster                        = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] compression_format             = gzip {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] compute_api_class              = cinder.compute.nova.API {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] config_dir                     = [] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] config_source                  = [] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] control_exchange               = openstack {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] debug                          = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] default_availability_zone      = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] default_group_type             = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] default_volume_type            = QuobyteHD {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] disk_geometry                  = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] driver_client_cert             = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] driver_client_cert_key         = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] driver_data_namespace          = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] driver_ssl_cert_path           = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] driver_ssl_cert_verify         = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] driver_use_ssl                 = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] enable_new_services            = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] enable_unsupported_driver      = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] enabled_backends               = ['QuobyteHD'] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] enforce_multipath_for_image_xfer = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] filter_function                = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance_api_insecure            = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance_api_servers             = ['http://192.168.122.77/image'] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance_api_ssl_compression     = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance_ca_certificates_file    = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance_catalog_info            = image:glance:publicURL {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance_certfile                = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance_keyfile                 = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance_num_retries             = 3 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance_request_timeout         = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] goodness_function              = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] graceful_shutdown_timeout      = 5 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] group_api_class                = cinder.group.api.API {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] host                           = devstack {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] image_compress_on_upload       = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] image_conversion_address_space_limit = 1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] image_conversion_cpu_limit     = 60 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] image_conversion_disable       = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] image_upload_use_cinder_backend = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] image_upload_use_internal_tenant = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] image_volume_cache_enabled     = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] image_volume_cache_max_count   = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] image_volume_cache_max_size_gb = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] init_host_max_objects_retrieval = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] instance_format                = [instance: %(uuid)s]  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] iscsi_target_flags             =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] iscsi_write_cache              = on {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] iser_helper                    = tgtadm {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] iser_ip_address                = 192.168.122.77 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] iser_port                      = 3260 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] log_color                      = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] log_config_append              = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] log_dir                        = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] log_file                       = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] log_options                    = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] log_rotate_interval            = 1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] log_rotate_interval_type       = days {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] log_rotation_type              = none {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] max_age                        = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] max_logfile_count              = 30 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] max_logfile_size_mb            = 200 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] max_over_subscription_ratio    = 20.0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] message_reap_interval          = 86400 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] message_ttl                    = 2592000 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] migration_create_volume_timeout_secs = 300 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] monkey_patch                   = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] monkey_patch_modules           = [] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] my_ip                          = 192.168.122.77 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] no_snapshot_gb_quota           = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] num_iser_scan_tries            = 3 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] num_shell_tries                = 3 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] num_volume_device_scan_tries   = 3 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] nvmeof_conn_info_version       = 1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] nvmet_ns_id                    = 10 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] nvmet_port_id                  = 1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] osapi_max_limit                = 1000 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] osapi_volume_ext_list          = [] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] osapi_volume_listen_port       = 8776 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] osapi_volume_use_ssl           = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] osapi_volume_workers           = 2 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] per_volume_size_limit          = -1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] periodic_fuzzy_delay           = 60 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] periodic_interval              = 60 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] public_endpoint                = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] publish_errors                 = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] quota_backup_gigabytes         = 1000 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] quota_backups                  = 10 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack sudo[84173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:11:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84165) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 29 10:11:08 devstack sudo[84173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] quota_gigabytes                = 1000 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] quota_groups                   = 10 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] quota_snapshots                = 10 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] quota_volumes                  = 10 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] rate_limit_burst               = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] rate_limit_except_level        = CRITICAL {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] rate_limit_interval            = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] reinit_driver_count            = 3 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] replication_device             = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] report_discard_supported       = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] report_interval                = 120 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] reservation_clean_interval     = 86400 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] reservation_expire             = 86400 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] reserved_image_namespaces      = [] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] reserved_percentage            = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] rpc_response_timeout           = 120 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] run_external_periodic_tasks    = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] scst_target_driver             = iscsi {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] scst_target_iqn_name           = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] service_down_time              = 720 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] shell_completion               = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] snapshot_name_template         = snapshot-%s {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] split_loggers                  = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] state_path                     = /opt/stack/data/cinder {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] storage_availability_zone      = nova {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] storage_protocol               = iSCSI {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] syslog_log_facility            = LOG_USER {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] target_helper                  = lioadm {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] target_ip_address              = 192.168.122.77 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] target_port                    = 3260 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] target_protocol                = iscsi {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] target_secondary_ip_addresses  = [] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] trace_flags                    = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] transport_url                  = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] until_refresh                  = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] use_chap_auth                  = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] use_default_quota_class        = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] use_journal                    = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] use_json                       = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] use_multipath_for_image_xfer   = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] use_stderr                     = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] use_syslog                     = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] verify_glance_signatures       = enabled {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] volume_api_class               = cinder.volume.api.API {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] volume_backend_name            = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] volume_clear                   = zero {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] volume_clear_ionice            = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] volume_clear_size              = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] volume_copy_bps_limit          = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] volume_dd_blocksize            = 1M {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] volume_name_template           = volume-%s {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] volume_service_inithost_offload = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] volume_usage_audit_period      = month {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] zoning_mode                    = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_concurrency.disable_process_locking = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.admin_password = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.admin_token = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.admin_user  = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.auth_port   = 35357 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.auth_protocol = https {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.auth_section = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.auth_type   = password {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.auth_uri    = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.auth_version = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.cache       = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.certfile    = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.delay_auth_decision = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.http_connect_timeout = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.identity_uri = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.include_service_catalog = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.insecure    = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.interface   = public {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.keyfile     = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_password =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcache_username =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.region_name = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.service_token_roles_required = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.service_type = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.token_cache_time = 300 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.77/identity {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.backend                  = dogpile.cache.null {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.backend_argument         = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.backend_expiration_time  = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84165) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 29 10:11:08 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.quobyte [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.config_prefix            = cache.oslo {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.quobyte [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.debug_cache_backend      = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.enable_retry_client      = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.enable_socket_keepalive  = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Running cmd (subprocess): mount.quobyte {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.enabled                  = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.enforce_fips_mode        = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.expiration_time          = 600 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.hashclient_retry_attempts = 2 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.memcache_dead_retry      = 300 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.memcache_pool_maxsize    = 10 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.memcache_sasl_enabled    = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.password                 = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.proxies                  = [] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.redis_db                 = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.redis_sentinel_service_name = mymaster {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.redis_server             = localhost:6379 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.retry_attempts           = 2 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.retry_delay              = 0.0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.socket_keepalive_count   = 1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.socket_keepalive_idle    = 1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.socket_keepalive_interval = 1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.socket_timeout           = 1.0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.tls_allowed_ciphers      = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.tls_cafile               = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.tls_certfile             = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.tls_enabled              = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.tls_keyfile              = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cache.username                 = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] coordination.backend_url       = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.asyncio_connection    = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.asyncio_slave_connection = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.backend               = sqlalchemy {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.connection            = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.connection_debug      = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.connection_parameters =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.connection_recycle_time = 3600 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.connection_trace      = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.db_inc_retry_interval = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.db_max_retries        = 20 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.db_max_retry_interval = 10 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.db_retry_interval     = 1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.max_overflow          = 50 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.max_pool_size         = 5 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.max_retries           = 10 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.mysql_wsrep_sync_wait = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.pool_timeout          = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.retry_interval        = 10 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.slave_connection      = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.sqlite_synchronous    = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.synchronous_reader    = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] database.use_db_reconnect      = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] profiler.connection_string     = messaging:// {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] profiler.enabled               = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] profiler.es_doc_type           = notification {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] profiler.es_scroll_size        = 10000 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] profiler.es_scroll_time        = 2m {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] profiler.filter_error_trace    = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] profiler.hmac_keys             = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] profiler.sentinel_service_name = mymaster {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] profiler.socket_timeout        = 0.1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] profiler.trace_requests        = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] profiler.trace_sqlalchemy      = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] profiler_jaeger.process_tags   = {} {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] profiler_jaeger.service_name_prefix = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] profiler_otlp.service_name_prefix = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_policy.enforce_new_defaults = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: WARNING oslo_config.cfg [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_policy.enforce_scope      = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_policy.policy_default_rule = default {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_policy.policy_file        = policy.yaml {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] privsep_osbrick.group          = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] privsep_osbrick.helper_command = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] privsep_osbrick.user           = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cinder_sys_admin.group         = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cinder_sys_admin.helper_command = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] cinder_sys_admin.user          = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] service_user.auth_section      = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] service_user.auth_type         = password {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] service_user.cafile            = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] service_user.certfile          = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] service_user.collect_timing    = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] service_user.insecure          = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] service_user.keyfile           = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] service_user.send_service_user_token = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] service_user.split_loggers     = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] service_user.timeout           = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance.auth_section            = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance.auth_type               = password {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance.certfile                = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance.collect_timing          = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance.insecure                = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance.keyfile                 = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance.region_name             = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance.split_loggers           = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] glance.timeout                 = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.backend_availability_zone = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.chap_password = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.chap_username =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.disk_geometry = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.driver_client_cert = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.driver_client_cert_key = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.driver_data_namespace = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.driver_use_ssl = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.enable_unsupported_driver = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.extra_capabilities = {} {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.filter_function = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.goodness_function = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.iscsi_target_flags =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.iscsi_write_cache = on {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.iser_helper   = tgtadm {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.iser_ip_address = 192.168.122.77 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.iser_port     = 3260 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.nas_host      =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.nas_login     = admin {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.nas_mount_options = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.nas_password  = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.nas_private_key =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.nas_share_path =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.num_shell_tries = 3 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.nvmet_port_id = 1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.quobyte_client_cfg = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.quobyte_volume_url = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.replication_device = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.report_discard_supported = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.reserved_percentage = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.scst_target_driver = iscsi {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.scst_target_iqn_name = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.storage_protocol = iSCSI {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.target_helper = tgtadm {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.target_ip_address = 192.168.122.77 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.target_port   = 3260 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.target_protocol = iscsi {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.trace_flags   = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.unique_fqdn_network = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.use_chap_auth = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.volume_backend_name = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.volume_clear  = zero {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.volume_clear_ionice = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.volume_clear_size = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_reports.file_event_handler = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_reports.log_dir           = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.backend_availability_zone = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.backend_host         = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.chap_password        = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.chap_username        = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.chiscsi_conf         = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.disk_geometry        = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.driver_client_cert   = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.driver_client_cert_key = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.driver_data_namespace = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.driver_use_ssl       = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.extra_capabilities   = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.filter_function      = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.goodness_function    = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.iser_helper          = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.iser_ip_address      = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.iser_port            = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.iser_target_prefix   = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.nas_host             = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.nas_login            = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.nas_mount_options    = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.nas_password         = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.nas_private_key      = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.nas_share_path       = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.nas_ssh_port         = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.num_shell_tries      = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.nvmet_port_id        = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.replication_device   = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.report_discard_supported = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.reserved_percentage  = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.scst_target_driver   = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.storage_protocol     = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.target_helper        = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.target_ip_address    = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.target_port          = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.target_prefix        = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.target_protocol      = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.trace_flags          = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.use_chap_auth        = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.volume_clear         = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.volume_clear_size    = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] QuobyteHD.volumes_dir          = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.ssl      = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_notifications.driver = [] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_notifications.retry = -1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] oslo_messaging_notifications.transport_url = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] key_manager.fixed_key          = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.barbican_api_version  = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.barbican_endpoint     = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.barbican_endpoint_type = public {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.barbican_region_name  = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.cafile                = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.certfile              = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.collect_timing        = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.insecure              = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.keyfile               = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.number_of_retries     = 60 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.retry_delay           = 1 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.send_service_user_token = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.split_loggers         = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.timeout               = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.verify_ssl            = True {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican.verify_ssl_path       = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican_service_user.auth_section = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican_service_user.auth_type = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican_service_user.cafile   = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican_service_user.certfile = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican_service_user.collect_timing = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican_service_user.insecure = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican_service_user.keyfile  = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican_service_user.split_loggers = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] barbican_service_user.timeout  = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] vault.approle_role_id          = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] vault.approle_secret_id        = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] vault.kv_mountpoint            = secret {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] vault.kv_path                  = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] vault.kv_version               = 2 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] vault.namespace                = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] vault.root_token_id            = **** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] vault.ssl_ca_crt_file          = None {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] vault.timeout                  = 60.0 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] vault.use_ssl                  = False {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 10:11:08 devstack cinder-volume[83919]: DEBUG oslo_service.backend._eventlet.service [None req-08f8f106-91ee-4de9-92fb-8396b282f37b None None] ******************************************************************************** {{(pid=83919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 29 10:11:09 devstack sudo[84173]: pam_unix(sudo:session): session closed for user root
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.613s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:11:09 devstack cinder-volume[84165]: INFO cinder.volume.driver [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Driver hasn't implemented _init_vendor_properties()
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG cinder.volume.driver [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327003479004, 'free_capacity_gb': 1775.7327003479004, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84165) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG oslo_db.sqlalchemy.engines [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84165) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writer thread running {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG cinder.db.sqlalchemy.api [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Building query based on filter {{(pid=84165) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84165) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:11:09 devstack cinder-volume[84165]: INFO cinder.keymgr.migration [None req-ac03cb16-3b5f-4aac-bef1-0a497c942ee2 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 29 10:11:09 devstack sudo[84181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:11:09 devstack sudo[84181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:11:09 devstack sudo[84181]: pam_unix(sudo:session): session closed for user root
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.568s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:11:09 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Driver initialization completed successfully.
Apr 29 10:11:09 devstack cinder-volume[84165]: INFO cinder.manager [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Initiating service 3 cleanup
Apr 29 10:11:09 devstack cinder-volume[84165]: INFO cinder.manager [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Service 3 cleanup completed.
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG cinder.service [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Creating RPC server for service cinder-volume {{(pid=84165) start /opt/stack/cinder/cinder/service.py:231}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG cinder.service [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84165) start /opt/stack/cinder/cinder/service.py:237}}
Apr 29 10:11:09 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:11:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:11:09 devstack sudo[84184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:11:09 devstack sudo[84184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:11:10 devstack sudo[84184]: pam_unix(sudo:session): session closed for user root
Apr 29 10:11:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.575s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:11:10 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-93c4c617-7d60-44ff-8f25-496ec0d4a27e None None] Driver post RPC initialization completed successfully.
Apr 29 10:11:18 devstack cinder-volume[83919]: DEBUG dbcounter [-] [83919] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83919) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:11:19 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=2 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:11:20 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Flow 'volume_create_manager' (e47d6cca-06ee-4c43-94f3-b1981f31a6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cabf5a3-e653-4f22-beaa-5be17bfa17c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cabf5a3-e653-4f22-beaa-5be17bfa17c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1894490958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdcc8bae-28df-4b55-98a4-1a6132bfa1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461f04160dc147dbb4052fa3662ae1b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:12:06Z,use_quota=True,user_id='e61ab779dae44a92a8fda5ca51f0addd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2dc40a-1d4b-40af-83b6-c91380b36fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2dc40a-1d4b-40af-83b6-c91380b36fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6105bacb-5a1f-4154-8591-cd3dc01ed434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6105bacb-5a1f-4154-8591-cd3dc01ed434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdcc8bae-28df-4b55-98a4-1a6132bfa1a1', 'volume_name': 'volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50e4df1-e13c-4f26-bc1c-7cbcef7c3ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50e4df1-e13c-4f26-bc1c-7cbcef7c3ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed88c87-a8c4-4d6b-a417-a4f82ffd900a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:06 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Volume bdcc8bae-28df-4b55-98a4-1a6132bfa1a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1', 'volume_size': 1}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1894490958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdcc8bae-28df-4b55-98a4-1a6132bfa1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461f04160dc147dbb4052fa3662ae1b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:12:06Z,use_quota=True,user_id='e61ab779dae44a92a8fda5ca51f0addd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Creating volume bdcc8bae-28df-4b55-98a4-1a6132bfa1a1 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:12:06 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:12:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:06 devstack sudo[84355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1 1073741824
Apr 29 10:12:06 devstack sudo[84355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:07 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:12:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Flow 'volume_create_manager' (eff00321-c21b-4868-8d04-473c09121f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:12:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f0dbe7-9131-4500-ad3e-2fe22c44ef7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f0dbe7-9131-4500-ad3e-2fe22c44ef7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1919306816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1770bfdc-02b9-426e-ad57-8788dceffbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23842503caa4633b2bd677835437250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:12:07Z,use_quota=True,user_id='12c7ccd6fdd34612993f310fe2e1ebfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67095b7-b67b-4d36-a431-1b98e862a10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67095b7-b67b-4d36-a431-1b98e862a10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f904b6-f69f-4fa8-963f-b84d497aae70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:07 devstack cinder-volume[84165]: DEBUG cinder.image.glance [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Creating Keystone auth plugin from conf {{(pid=84165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 10:12:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f904b6-f69f-4fa8-963f-b84d497aae70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1770bfdc-02b9-426e-ad57-8788dceffbff', 'volume_name': 'volume-1770bfdc-02b9-426e-ad57-8788dceffbff', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5250e94a40>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ec6ce4-4fc0-46cd-ac20-28b55ea50c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ec6ce4-4fc0-46cd-ac20-28b55ea50c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1272103a-d75f-4f53-8dee-276e68e3fd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:07 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Volume 1770bfdc-02b9-426e-ad57-8788dceffbff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1770bfdc-02b9-426e-ad57-8788dceffbff', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5250e94a40>}
Apr 29 10:12:07 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Trying to clone 1770bfdc-02b9-426e-ad57-8788dceffbff from image 718e863a-88e0-4753-95be-273177fb3fd1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]). {{(pid=84165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 29 10:12:07 devstack sudo[84355]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1 1073741824" returned: 0 in 1.102s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:07 devstack sudo[84694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1
Apr 29 10:12:07 devstack sudo[84694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:08 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f7nczd9jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 10:12:08 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 10:12:08 devstack cinder-volume[84165]: INFO oslo.privsep.daemon [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprwtdnxbn/privsep.sock']
Apr 29 10:12:08 devstack sudo[84697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprwtdnxbn/privsep.sock
Apr 29 10:12:08 devstack sudo[84697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:08 devstack sudo[84694]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1" returned: 0 in 0.750s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:12:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:12:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed88c87-a8c4-4d6b-a417-a4f82ffd900a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621a1a55-9bc8-4ca5-82f9-5748c23d834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:08 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Volume volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1 (bdcc8bae-28df-4b55-98a4-1a6132bfa1a1): created successfully
Apr 29 10:12:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621a1a55-9bc8-4ca5-82f9-5748c23d834d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Flow 'volume_create_manager' (e47d6cca-06ee-4c43-94f3-b1981f31a6d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:12:08 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-2f360c44-7e4c-46d0-a085-b6062d72e318 tempest-VolumesAssistedSnapshotsTest-911064855 None] Created volume successfully.
Apr 29 10:12:10 devstack sudo[84697]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:10 devstack cinder-volume[84165]: INFO oslo.privsep.daemon [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Spawned new privsep daemon via rootwrap
Apr 29 10:12:10 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Accepted privsep connection to /tmp/tmprwtdnxbn/privsep.sock {{(pid=84165) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}}
Apr 29 10:12:10 devstack cinder-volume[84165]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 29 10:12:10 devstack cinder-volume[84165]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 29 10:12:10 devstack cinder-volume[84165]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 29 10:12:10 devstack cinder-volume[84165]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84703
Apr 29 10:12:10 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[edae61d1-82d7-4ea7-89a1-93330a385b5a]: (2,) {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:12:10 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86c0952-f132-4604-9748-76b615774534]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:12:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f7nczd9jdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:10 devstack sudo[84708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f7nczd9jdevstack@QuobyteHD
Apr 29 10:12:10 devstack sudo[84708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:10 devstack sudo[84708]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f7nczd9jdevstack@QuobyteHD" returned: 0 in 0.760s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:10 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 is fetched for user 12c7ccd6fdd34612993f310fe2e1ebfe. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 10:12:11 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c807f6e5-91ea-49b2-97fd-1e6544cc5f7b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:12:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f7nczd9jdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:11 devstack sudo[84715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f7nczd9jdevstack@QuobyteHD
Apr 29 10:12:11 devstack sudo[84715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:11 devstack sudo[84715]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f7nczd9jdevstack@QuobyteHD" returned: 0 in 0.865s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:12:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:12:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1919306816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1770bfdc-02b9-426e-ad57-8788dceffbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23842503caa4633b2bd677835437250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:12:07Z,use_quota=True,user_id='12c7ccd6fdd34612993f310fe2e1ebfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:12:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Creating volume 1770bfdc-02b9-426e-ad57-8788dceffbff {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:12:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:12:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:12:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:12:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:12:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:12:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:12:12 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:12:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:12 devstack sudo[84725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff 1073741824
Apr 29 10:12:12 devstack sudo[84725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:12 devstack sudo[84725]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff 1073741824" returned: 0 in 0.966s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:13 devstack sudo[84735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff
Apr 29 10:12:13 devstack sudo[84735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:13 devstack sudo[84735]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff" returned: 0 in 0.663s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:12:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:12:13 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Attempting download of 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume 1770bfdc-02b9-426e-ad57-8788dceffbff. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 10:12:13 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b87531-df0b-4969-bed7-6a2161a14097]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:12:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_ymdiwnjv {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:14 devstack sudo[84762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_ymdiwnjv
Apr 29 10:12:14 devstack sudo[84762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:15 devstack sudo[84762]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_ymdiwnjv" returned: 0 in 1.628s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_ymdiwnjv {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:15 devstack sudo[84805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_ymdiwnjv
Apr 29 10:12:15 devstack sudo[84805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:17 devstack sudo[84805]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_ymdiwnjv" returned: 1 in 1.567s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_ymdiwnjv' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:12:17 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c47fbb-e328-469d-ba57-2d1fd164bd4d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:12:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f7nczd9jdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:17 devstack sudo[84812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f7nczd9jdevstack@QuobyteHD
Apr 29 10:12:17 devstack sudo[84812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:18 devstack sudo[84812]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f7nczd9jdevstack@QuobyteHD" returned: 0 in 1.506s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:18 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] 718e863a-88e0-4753-95be-273177fb3fd1 was qcow2, converting to raw {{(pid=84165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 10:12:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f7nczd9jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:18 devstack sudo[84828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f7nczd9jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff
Apr 29 10:12:18 devstack sudo[84828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Flow 'volume_create_manager' (b42d6edf-ea35-4cc1-b4df-f5b02ebc7984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9164c673-25e9-41a6-b39e-a3ca9644cc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9164c673-25e9-41a6-b39e-a3ca9644cc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1658307537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea0e22e-c4bf-4545-927c-81e6ac8bb7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43873b4a212045538e998f0b15c4db0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:12:19Z,use_quota=True,user_id='53c49e98d53c44eb98c87aaa057c1046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14cfccdc-a5d0-4b79-a466-7d525c4ef9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14cfccdc-a5d0-4b79-a466-7d525c4ef9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bff0d87-3097-4927-a2f4-496898d0507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bff0d87-3097-4927-a2f4-496898d0507f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fea0e22e-c4bf-4545-927c-81e6ac8bb7e8', 'volume_name': 'volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b61b30-d927-498e-b77d-95cce0877595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b61b30-d927-498e-b77d-95cce0877595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0f0d07-5f85-43ca-8ac1-54e1b85591e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:19 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Volume fea0e22e-c4bf-4545-927c-81e6ac8bb7e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8', 'volume_size': 1}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1658307537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea0e22e-c4bf-4545-927c-81e6ac8bb7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43873b4a212045538e998f0b15c4db0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:12:19Z,use_quota=True,user_id='53c49e98d53c44eb98c87aaa057c1046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Creating volume fea0e22e-c4bf-4545-927c-81e6ac8bb7e8 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:12:19 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:12:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:19 devstack sudo[84836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8 1073741824
Apr 29 10:12:19 devstack sudo[84836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:20 devstack sudo[84836]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8 1073741824" returned: 0 in 1.476s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:21 devstack sudo[84841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8
Apr 29 10:12:21 devstack sudo[84841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:22 devstack sudo[84828]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f7nczd9jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff" returned: 0 in 3.507s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:22 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f7nczd9jdevstack@QuobyteHD, size 112.00 MB, duration 3.51 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:12:22 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Converted 112.00 MB image at 31.87 MB/s
Apr 29 10:12:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:22 devstack sudo[84843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff 1G
Apr 29 10:12:22 devstack sudo[84843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:22 devstack sudo[84841]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8" returned: 0 in 1.494s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] <== create_volume: return (3053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:12:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.061s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:12:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0f0d07-5f85-43ca-8ac1-54e1b85591e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116b90d7-022e-490b-956e-612714c9d553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:22 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Volume volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8 (fea0e22e-c4bf-4545-927c-81e6ac8bb7e8): created successfully
Apr 29 10:12:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116b90d7-022e-490b-956e-612714c9d553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Flow 'volume_create_manager' (b42d6edf-ea35-4cc1-b4df-f5b02ebc7984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:12:22 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-28a18bfd-b5d6-49a0-b135-5dbb472dd9ce tempest-DeleteServersTestJSON-893865591 None] Created volume successfully.
Apr 29 10:12:23 devstack sudo[84843]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff 1G" returned: 0 in 1.137s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:23 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef16694-f2a5-4472-a58b-53b70e532575]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:12:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:23 devstack sudo[84860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff
Apr 29 10:12:23 devstack sudo[84860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:24 devstack sudo[84860]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff" returned: 0 in 1.257s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:24 devstack sudo[84901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff
Apr 29 10:12:24 devstack sudo[84901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:25 devstack sudo[84901]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff" returned: 1 in 1.212s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:12:25 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Downloaded image 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume 1770bfdc-02b9-426e-ad57-8788dceffbff successfully. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 10:12:25 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 for user 12c7ccd6fdd34612993f310fe2e1ebfe is deleted. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 10:12:25 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Marking volume 1770bfdc-02b9-426e-ad57-8788dceffbff as bootable. {{(pid=84165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 10:12:25 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Copying metadata from image 718e863a-88e0-4753-95be-273177fb3fd1 to 1770bfdc-02b9-426e-ad57-8788dceffbff. {{(pid=84165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 10:12:25 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Creating volume glance metadata for volume 1770bfdc-02b9-426e-ad57-8788dceffbff backed by image 718e863a-88e0-4753-95be-273177fb3fd1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 10:12:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1272103a-d75f-4f53-8dee-276e68e3fd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1770bfdc-02b9-426e-ad57-8788dceffbff', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5250e94a40>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7366d907-cd34-4df9-acbd-87e4b653dbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:26 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Volume volume-1770bfdc-02b9-426e-ad57-8788dceffbff (1770bfdc-02b9-426e-ad57-8788dceffbff): created successfully
Apr 29 10:12:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7366d907-cd34-4df9-acbd-87e4b653dbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Flow 'volume_create_manager' (eff00321-c21b-4868-8d04-473c09121f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:12:26 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-4da3ce0b-3168-47ba-9564-441c9c1fef17 tempest-TaggedBootDevicesTest-739208576 None] Created volume successfully.
Apr 29 10:12:27 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:12:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Flow 'volume_create_manager' (6b7b5e6a-8d6d-4090-8730-c1eeb4dd61e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:12:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58f28d3-d13b-4e03-b992-605370c353a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58f28d3-d13b-4e03-b992-605370c353a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1439089999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf36d1cb-45c6-4a06-8d31-3289d282f010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23842503caa4633b2bd677835437250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:12:28Z,use_quota=True,user_id='12c7ccd6fdd34612993f310fe2e1ebfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b40777-1a9d-4874-92ed-9f75e701978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b40777-1a9d-4874-92ed-9f75e701978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20e7fb1-c74d-4787-9138-16df8d96f263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20e7fb1-c74d-4787-9138-16df8d96f263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf36d1cb-45c6-4a06-8d31-3289d282f010', 'volume_name': 'volume-bf36d1cb-45c6-4a06-8d31-3289d282f010', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa58efe1-a21a-4785-8c9c-ae724c6616b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa58efe1-a21a-4785-8c9c-ae724c6616b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb489d2-45d8-47d1-96f1-b7aff38c52a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:28 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Volume bf36d1cb-45c6-4a06-8d31-3289d282f010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf36d1cb-45c6-4a06-8d31-3289d282f010', 'volume_size': 1}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1439089999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf36d1cb-45c6-4a06-8d31-3289d282f010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23842503caa4633b2bd677835437250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:12:28Z,use_quota=True,user_id='12c7ccd6fdd34612993f310fe2e1ebfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Creating volume bf36d1cb-45c6-4a06-8d31-3289d282f010 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:12:28 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:12:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bf36d1cb-45c6-4a06-8d31-3289d282f010 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:28 devstack sudo[84931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bf36d1cb-45c6-4a06-8d31-3289d282f010 1073741824
Apr 29 10:12:28 devstack sudo[84931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:29 devstack sudo[84931]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bf36d1cb-45c6-4a06-8d31-3289d282f010 1073741824" returned: 0 in 1.323s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bf36d1cb-45c6-4a06-8d31-3289d282f010 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:29 devstack sudo[84966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bf36d1cb-45c6-4a06-8d31-3289d282f010
Apr 29 10:12:29 devstack sudo[84966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:30 devstack sudo[84966]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bf36d1cb-45c6-4a06-8d31-3289d282f010" returned: 0 in 0.685s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:12:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:12:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb489d2-45d8-47d1-96f1-b7aff38c52a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf36d1cb-45c6-4a06-8d31-3289d282f010', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb7d0a8-7fd9-4973-a2e2-81e9eca8efc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:30 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Volume volume-bf36d1cb-45c6-4a06-8d31-3289d282f010 (bf36d1cb-45c6-4a06-8d31-3289d282f010): created successfully
Apr 29 10:12:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb7d0a8-7fd9-4973-a2e2-81e9eca8efc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Flow 'volume_create_manager' (6b7b5e6a-8d6d-4090-8730-c1eeb4dd61e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:12:30 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a3b910b5-f2fb-4ba7-826a-a6d1ee1aa581 tempest-TaggedBootDevicesTest-739208576 None] Created volume successfully.
Apr 29 10:12:30 devstack cinder-volume[84165]: WARNING py.warnings [req-febf603b-70e2-4cfe-9c87-978f8556f1d1 req-e06b9360-0b77-4bba-89ee-30c0974ee886 tempest-DeleteServersTestJSON-893865591 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 29 10:12:30 devstack cinder-volume[84165]:   .first()
Apr 29 10:12:30 devstack cinder-volume[84165]: 
Apr 29 10:12:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-febf603b-70e2-4cfe-9c87-978f8556f1d1 req-e06b9360-0b77-4bba-89ee-30c0974ee886 tempest-DeleteServersTestJSON-893865591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:12:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-febf603b-70e2-4cfe-9c87-978f8556f1d1 req-e06b9360-0b77-4bba-89ee-30c0974ee886 tempest-DeleteServersTestJSON-893865591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:12:30 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdc8982-59ed-4816-8dfe-6c11c86caf6d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:12:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-febf603b-70e2-4cfe-9c87-978f8556f1d1 req-e06b9360-0b77-4bba-89ee-30c0974ee886 tempest-DeleteServersTestJSON-893865591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:30 devstack sudo[84985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8
Apr 29 10:12:30 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:31 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-febf603b-70e2-4cfe-9c87-978f8556f1d1 req-e06b9360-0b77-4bba-89ee-30c0974ee886 tempest-DeleteServersTestJSON-893865591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8" returned: 0 in 0.757s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-febf603b-70e2-4cfe-9c87-978f8556f1d1 req-e06b9360-0b77-4bba-89ee-30c0974ee886 tempest-DeleteServersTestJSON-893865591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.780s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-febf603b-70e2-4cfe-9c87-978f8556f1d1 req-e06b9360-0b77-4bba-89ee-30c0974ee886 tempest-DeleteServersTestJSON-893865591 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f495059-9f2d-4b5c-bafa-cf59aa90554c', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:12:31 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-febf603b-70e2-4cfe-9c87-978f8556f1d1 req-e06b9360-0b77-4bba-89ee-30c0974ee886 tempest-DeleteServersTestJSON-893865591 None] attachment_update completed successfully.
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Flow 'volume_create_manager' (c4eebd0b-66c4-44f8-a2c0-bb249472602f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b39ebd-5840-4ef5-a69e-2b022571e138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b39ebd-5840-4ef5-a69e-2b022571e138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1386901923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c93d46-c86b-4c73-bae2-edfdc19064a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23842503caa4633b2bd677835437250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:12:32Z,use_quota=True,user_id='12c7ccd6fdd34612993f310fe2e1ebfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a31bbbe-6c3e-4934-97bb-900b7484d7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a31bbbe-6c3e-4934-97bb-900b7484d7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8246eabf-1015-4a6b-b593-fcba610d69c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8246eabf-1015-4a6b-b593-fcba610d69c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c93d46-c86b-4c73-bae2-edfdc19064a4', 'volume_name': 'volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054a9150-acad-40cd-bf59-475c06679e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054a9150-acad-40cd-bf59-475c06679e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47bdd51-466d-491d-8048-2dcd9c0527e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:31 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Volume f1c93d46-c86b-4c73-bae2-edfdc19064a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4', 'volume_size': 1}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1386901923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c93d46-c86b-4c73-bae2-edfdc19064a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23842503caa4633b2bd677835437250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:12:32Z,use_quota=True,user_id='12c7ccd6fdd34612993f310fe2e1ebfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Creating volume f1c93d46-c86b-4c73-bae2-edfdc19064a4 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:12:31 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:12:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:32 devstack sudo[85043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4 1073741824
Apr 29 10:12:32 devstack sudo[85043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:33 devstack sudo[85043]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4 1073741824" returned: 0 in 1.154s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:33 devstack sudo[85129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4
Apr 29 10:12:33 devstack sudo[85129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:34 devstack sudo[85129]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4" returned: 0 in 1.322s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] <== create_volume: return (2529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:12:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.531s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:12:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47bdd51-466d-491d-8048-2dcd9c0527e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a536b789-b3cd-4eda-a59c-daa2654b6ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:12:34 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Volume volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4 (f1c93d46-c86b-4c73-bae2-edfdc19064a4): created successfully
Apr 29 10:12:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a536b789-b3cd-4eda-a59c-daa2654b6ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:12:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Flow 'volume_create_manager' (c4eebd0b-66c4-44f8-a2c0-bb249472602f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:12:34 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-9c7e6a54-8008-4549-be6c-cc5ebfbf2f83 tempest-TaggedBootDevicesTest-739208576 None] Created volume successfully.
Apr 29 10:12:44 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-cb84c9dc-a49e-4a68-9193-874a2570f03d req-e27c1857-e88a-4b33-8a2a-6bb752313666 tempest-DeleteServersTestJSON-893865591 None] Terminate volume connection completed successfully.
Apr 29 10:12:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-cb84c9dc-a49e-4a68-9193-874a2570f03d req-e27c1857-e88a-4b33-8a2a-6bb752313666 tempest-DeleteServersTestJSON-893865591 None] Deleting attachment 0f495059-9f2d-4b5c-bafa-cf59aa90554c. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:12:44 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=23,cinder:SELECT=24,cinder:INSERT=5,cinder:DELETE=2 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:12:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Acquiring lock "cinder-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:12:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Lock "cinder-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:12:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Acquiring lock "cinder-quobyte-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:12:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Lock "cinder-quobyte-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:12:49 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0d3044-afc5-45d2-85f5-01584479a17b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:12:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:49 devstack sudo[85552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8
Apr 29 10:12:49 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:49 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8" returned: 0 in 0.789s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:49 devstack sudo[85557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8
Apr 29 10:12:49 devstack sudo[85557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:50 devstack sudo[85557]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8" returned: 0 in 0.660s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:50 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Lock "cinder-quobyte-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8" released by "delete_volume" :: held 1.505s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:12:50 devstack cinder-volume[84165]: WARNING cinder.quota [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:12:50 devstack cinder-volume[84165]: WARNING cinder.quota [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:12:50 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Created reservations ['75a9d35f-ef4f-4be2-89d6-ac093b5a0837', 'ab2ec10c-e2b3-4e46-bd24-e7ae471e80e2', 'f38cb7d9-c614-4c09-b5bd-f7ae98d7fd7b', 'f497fb4c-9731-4407-b3f6-0f3256efce74'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:12:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:12:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:12:50 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:12:50 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:12:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:12:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:12:50 devstack sudo[85560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:12:50 devstack sudo[85560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:12:51 devstack sudo[85560]: pam_unix(sudo:session): session closed for user root
Apr 29 10:12:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.661s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:12:51 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:12:51 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Deleted volume successfully.
Apr 29 10:12:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-23d2aece-2488-4a09-8033-88c9592a43e3 tempest-DeleteServersTestJSON-893865591 None] Lock "cinder-fea0e22e-c4bf-4545-927c-81e6ac8bb7e8-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:13:00 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:13:01 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=26,cinder:UPDATE=22,cinder:INSERT=14,cinder:DELETE=4 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:13:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-29bb09e7-5443-4d28-872b-1365b3d1fe14 req-a3a00140-2104-482d-9633-a14fa7c848ea tempest-VolumesAssistedSnapshotsTest-911064855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:13:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-29bb09e7-5443-4d28-872b-1365b3d1fe14 req-a3a00140-2104-482d-9633-a14fa7c848ea tempest-VolumesAssistedSnapshotsTest-911064855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:13:02 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83945bb-765b-4c7d-adb8-f10dd9f1f0c5]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:13:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-29bb09e7-5443-4d28-872b-1365b3d1fe14 req-a3a00140-2104-482d-9633-a14fa7c848ea tempest-VolumesAssistedSnapshotsTest-911064855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:03 devstack sudo[85617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1
Apr 29 10:13:03 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:03 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-29bb09e7-5443-4d28-872b-1365b3d1fe14 req-a3a00140-2104-482d-9633-a14fa7c848ea tempest-VolumesAssistedSnapshotsTest-911064855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1" returned: 0 in 0.858s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-29bb09e7-5443-4d28-872b-1365b3d1fe14 req-a3a00140-2104-482d-9633-a14fa7c848ea tempest-VolumesAssistedSnapshotsTest-911064855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.905s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:13:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-29bb09e7-5443-4d28-872b-1365b3d1fe14 req-a3a00140-2104-482d-9633-a14fa7c848ea tempest-VolumesAssistedSnapshotsTest-911064855 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a94feb82-e9a3-4de8-88db-4fe3439ba1b0', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:13:03 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-29bb09e7-5443-4d28-872b-1365b3d1fe14 req-a3a00140-2104-482d-9633-a14fa7c848ea tempest-VolumesAssistedSnapshotsTest-911064855 None] attachment_update completed successfully.
Apr 29 10:13:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:13:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:13:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:13:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:13:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:13:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:13:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:05 devstack sudo[86005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:13:05 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:06 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.793s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:13:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c9cedf04-1a04-4271-b6db-602b996c66bd tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:13:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c9cedf04-1a04-4271-b6db-602b996c66bd tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:13:09 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95dde0e-9eb1-45ca-be7d-378158ae9f3c]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:13:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c9cedf04-1a04-4271-b6db-602b996c66bd tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:09 devstack sudo[86016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff
Apr 29 10:13:09 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:10 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c9cedf04-1a04-4271-b6db-602b996c66bd tempest-TaggedBootDevicesTest-739208576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff" returned: 0 in 0.967s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c9cedf04-1a04-4271-b6db-602b996c66bd tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:10 devstack sudo[86020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff
Apr 29 10:13:10 devstack sudo[86020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:11 devstack sudo[86020]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c9cedf04-1a04-4271-b6db-602b996c66bd tempest-TaggedBootDevicesTest-739208576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff" returned: 1 in 0.785s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c9cedf04-1a04-4271-b6db-602b996c66bd tempest-TaggedBootDevicesTest-739208576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:13:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c9cedf04-1a04-4271-b6db-602b996c66bd tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.819s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:13:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c9cedf04-1a04-4271-b6db-602b996c66bd tempest-TaggedBootDevicesTest-739208576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-1770bfdc-02b9-426e-ad57-8788dceffbff', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29afc4ca-0baa-462a-8175-cac8fe423e7f', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:13:11 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c9cedf04-1a04-4271-b6db-602b996c66bd tempest-TaggedBootDevicesTest-739208576 None] attachment_update completed successfully.
Apr 29 10:13:12 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-67529b06-8f03-4acc-be3a-d1d0c6ff27ff req-85440d41-d481-4b9e-8998-695459047451 tempest-VolumesAssistedSnapshotsTest-911064855 None] Terminate volume connection completed successfully.
Apr 29 10:13:12 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-67529b06-8f03-4acc-be3a-d1d0c6ff27ff req-85440d41-d481-4b9e-8998-695459047451 tempest-VolumesAssistedSnapshotsTest-911064855 None] Deleting attachment a94feb82-e9a3-4de8-88db-4fe3439ba1b0. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:13:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c37d5b39-cab0-4401-9ad4-f2c90fcffd6c tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:13:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c37d5b39-cab0-4401-9ad4-f2c90fcffd6c tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:13:13 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa481e3d-30a2-4c44-8868-ca04ca670b38]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:13:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c37d5b39-cab0-4401-9ad4-f2c90fcffd6c tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bf36d1cb-45c6-4a06-8d31-3289d282f010 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:13 devstack sudo[86061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bf36d1cb-45c6-4a06-8d31-3289d282f010
Apr 29 10:13:13 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:14 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c37d5b39-cab0-4401-9ad4-f2c90fcffd6c tempest-TaggedBootDevicesTest-739208576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bf36d1cb-45c6-4a06-8d31-3289d282f010" returned: 0 in 1.027s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c37d5b39-cab0-4401-9ad4-f2c90fcffd6c tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.054s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:13:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c37d5b39-cab0-4401-9ad4-f2c90fcffd6c tempest-TaggedBootDevicesTest-739208576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-bf36d1cb-45c6-4a06-8d31-3289d282f010', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ecb25a0-9523-49a0-97ad-962ff8690a56', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:13:14 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-c37d5b39-cab0-4401-9ad4-f2c90fcffd6c tempest-TaggedBootDevicesTest-739208576 None] attachment_update completed successfully.
Apr 29 10:13:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Acquiring lock "cinder-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:13:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Lock "cinder-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:13:14 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:13:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Flow 'volume_create_manager' (c2503d50-2569-4862-9493-409f879f987a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:13:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3162e7bf-bc27-43a1-a25c-18b884440530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Acquiring lock "cinder-quobyte-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:13:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3162e7bf-bc27-43a1-a25c-18b884440530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1696336602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b872cf00-1938-4fcc-b33c-62c300a10232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347fb505b8ec40878b3b741620f4d250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:13:15Z,use_quota=True,user_id='f5f3640421d4479d95ec1b2c12c56352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9eb56bb-7aae-45b4-9e4f-d8033b497205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9eb56bb-7aae-45b4-9e4f-d8033b497205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f443c3-3de0-437f-ad24-6a89d2005e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:15 devstack cinder-volume[84165]: DEBUG cinder.image.glance [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Creating Keystone auth plugin from conf {{(pid=84165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 10:13:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Lock "cinder-quobyte-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1" acquired by "delete_volume" :: waited 0.087s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:13:15 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7581dfe-159f-47da-93ae-54bc52cfc6a5]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:13:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:15 devstack sudo[86067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1
Apr 29 10:13:15 devstack sudo[86067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f443c3-3de0-437f-ad24-6a89d2005e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b872cf00-1938-4fcc-b33c-62c300a10232', 'volume_name': 'volume-b872cf00-1938-4fcc-b33c-62c300a10232', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52469727b0>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d588e77a-74d9-4184-933a-0fe81d66bdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d588e77a-74d9-4184-933a-0fe81d66bdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd70cdf-88a9-4484-9cc3-9efff0cb2e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:15 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Volume b872cf00-1938-4fcc-b33c-62c300a10232: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b872cf00-1938-4fcc-b33c-62c300a10232', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52469727b0>}
Apr 29 10:13:15 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Trying to clone b872cf00-1938-4fcc-b33c-62c300a10232 from image 718e863a-88e0-4753-95be-273177fb3fd1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]). {{(pid=84165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 29 10:13:16 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_zjzy70dxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 10:13:16 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 10:13:16 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d829a00-9e52-423a-927c-83622ab55d7e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:13:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_zjzy70dxdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:16 devstack sudo[86081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_zjzy70dxdevstack@QuobyteHD
Apr 29 10:13:16 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:16 devstack sudo[86067]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1" returned: 0 in 1.275s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:16 devstack sudo[86083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1
Apr 29 10:13:16 devstack sudo[86083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-ca7e70cb-a98d-44d7-b6ba-b73d86dfe3fe tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:13:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-ca7e70cb-a98d-44d7-b6ba-b73d86dfe3fe tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:13:16 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d77a79e-a06c-4370-bdb2-6a428e81f66e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:13:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-ca7e70cb-a98d-44d7-b6ba-b73d86dfe3fe tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:16 devstack sudo[86085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4
Apr 29 10:13:16 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:16 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_zjzy70dxdevstack@QuobyteHD" returned: 0 in 0.781s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:16 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 is fetched for user f5f3640421d4479d95ec1b2c12c56352. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 10:13:17 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5553c3a-57d3-438e-adce-7e18dc6785bd]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:13:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_zjzy70dxdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:17 devstack sudo[86091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_zjzy70dxdevstack@QuobyteHD
Apr 29 10:13:17 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:17 devstack sudo[86083]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1" returned: 0 in 1.068s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:17 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Lock "cinder-quobyte-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1" released by "delete_volume" :: held 2.404s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:13:17 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Created reservations ['49430215-c78c-4c79-afb3-77226ff09161', '2fc2d075-dbcc-402b-9072-b79234cc3a15', '2c17715c-c772-49d1-9aa0-e088806337ac', '88614c73-afc0-4be0-ba78-04b81d7c3fd4'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:13:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:13:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:13:17 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:13:17 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:13:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:13:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:17 devstack sudo[86095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:13:17 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:17 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-ca7e70cb-a98d-44d7-b6ba-b73d86dfe3fe tempest-TaggedBootDevicesTest-739208576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4" returned: 0 in 1.504s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-ca7e70cb-a98d-44d7-b6ba-b73d86dfe3fe tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.532s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:13:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-ca7e70cb-a98d-44d7-b6ba-b73d86dfe3fe tempest-TaggedBootDevicesTest-739208576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32c55bc5-ce23-4c0c-983a-aaa95e45f73b', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:13:18 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-501e43af-6006-4312-8c7f-4b47c03b3e92 req-ca7e70cb-a98d-44d7-b6ba-b73d86dfe3fe tempest-TaggedBootDevicesTest-739208576 None] attachment_update completed successfully.
Apr 29 10:13:18 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_zjzy70dxdevstack@QuobyteHD" returned: 0 in 1.097s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:13:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:13:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1696336602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b872cf00-1938-4fcc-b33c-62c300a10232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347fb505b8ec40878b3b741620f4d250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:13:15Z,use_quota=True,user_id='f5f3640421d4479d95ec1b2c12c56352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:13:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Creating volume b872cf00-1938-4fcc-b33c-62c300a10232 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:13:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:13:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:13:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:13:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:13:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:13:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:13:18 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:13:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:18 devstack sudo[86103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 1073741824
Apr 29 10:13:18 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:18 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.270s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:18 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:13:18 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Deleted volume successfully.
Apr 29 10:13:19 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d37e58e7-7ee3-4774-85d8-5a2d9d5a27d0 tempest-VolumesAssistedSnapshotsTest-911064855 None] Lock "cinder-bdcc8bae-28df-4b55-98a4-1a6132bfa1a1-delete_volume" released by "delete_volume" :: held 4.208s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:13:19 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 1073741824" returned: 0 in 1.280s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:19 devstack sudo[86124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232
Apr 29 10:13:19 devstack sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232" returned: 0 in 1.353s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] <== create_volume: return (2711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:13:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.714s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:13:20 devstack sudo[86124]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:20 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Attempting download of 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume b872cf00-1938-4fcc-b33c-62c300a10232. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 10:13:21 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d351e21a-1091-4770-ad83-cf5fe842bd1a]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:13:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_9w4h3ajv {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:21 devstack sudo[86204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_9w4h3ajv
Apr 29 10:13:21 devstack sudo[86204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:21 devstack sudo[86204]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_9w4h3ajv" returned: 0 in 0.886s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_9w4h3ajv {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:22 devstack sudo[86218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_9w4h3ajv
Apr 29 10:13:22 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:22 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_9w4h3ajv" returned: 1 in 0.816s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_9w4h3ajv' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:13:22 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[323796cc-8650-4e3c-8fc0-e58f564fd9ca]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:13:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_zjzy70dxdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:22 devstack sudo[86225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_zjzy70dxdevstack@QuobyteHD
Apr 29 10:13:22 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:23 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_zjzy70dxdevstack@QuobyteHD" returned: 0 in 0.717s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:23 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] 718e863a-88e0-4753-95be-273177fb3fd1 was qcow2, converting to raw {{(pid=84165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 10:13:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_zjzy70dxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:23 devstack sudo[86232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_zjzy70dxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232
Apr 29 10:13:23 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:25 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_zjzy70dxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232" returned: 0 in 2.346s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:25 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_zjzy70dxdevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:13:25 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Converted 112.00 MB image at 47.71 MB/s
Apr 29 10:13:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:25 devstack sudo[86251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 1G
Apr 29 10:13:25 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:26 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 1G" returned: 0 in 0.733s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:26 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de4bb49-4b99-4ccb-b47c-4d833503e159]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:13:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:26 devstack sudo[86256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232
Apr 29 10:13:26 devstack sudo[86256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:27 devstack sudo[86256]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232" returned: 0 in 0.822s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:27 devstack sudo[86262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232
Apr 29 10:13:27 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:28 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232" returned: 1 in 0.888s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:13:28 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Downloaded image 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume b872cf00-1938-4fcc-b33c-62c300a10232 successfully. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 10:13:28 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 for user f5f3640421d4479d95ec1b2c12c56352 is deleted. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 10:13:28 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Marking volume b872cf00-1938-4fcc-b33c-62c300a10232 as bootable. {{(pid=84165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 10:13:28 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Copying metadata from image 718e863a-88e0-4753-95be-273177fb3fd1 to b872cf00-1938-4fcc-b33c-62c300a10232. {{(pid=84165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 10:13:28 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Creating volume glance metadata for volume b872cf00-1938-4fcc-b33c-62c300a10232 backed by image 718e863a-88e0-4753-95be-273177fb3fd1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 10:13:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd70cdf-88a9-4484-9cc3-9efff0cb2e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b872cf00-1938-4fcc-b33c-62c300a10232', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52469727b0>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d7299d-658b-4593-9b7e-46c7532a381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:28 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Volume volume-b872cf00-1938-4fcc-b33c-62c300a10232 (b872cf00-1938-4fcc-b33c-62c300a10232): created successfully
Apr 29 10:13:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d7299d-658b-4593-9b7e-46c7532a381e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Flow 'volume_create_manager' (c2503d50-2569-4862-9493-409f879f987a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:13:28 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3e50ac31-71fe-4f3c-8e19-c90da493f1b5 tempest-TaggedBootDevicesTest_v242-560316634 None] Created volume successfully.
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Flow 'volume_create_manager' (b286ac30-fdef-400d-add0-8312eb5ce3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c332458f-b7b8-459b-aaa9-bb3f3e660dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c332458f-b7b8-459b-aaa9-bb3f3e660dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1755620509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86acedd9-036a-4cc6-a0fe-005da522fc7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347fb505b8ec40878b3b741620f4d250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:13:30Z,use_quota=True,user_id='f5f3640421d4479d95ec1b2c12c56352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fde8813-7585-4669-8eb5-b5c2ad2cc3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fde8813-7585-4669-8eb5-b5c2ad2cc3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3bb58d-944b-43bb-b7e9-cc4bf82daf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3bb58d-944b-43bb-b7e9-cc4bf82daf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86acedd9-036a-4cc6-a0fe-005da522fc7b', 'volume_name': 'volume-86acedd9-036a-4cc6-a0fe-005da522fc7b', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf90d3f-0bc5-4375-b8cb-3414e9db7dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf90d3f-0bc5-4375-b8cb-3414e9db7dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fcfd37d-136c-4fba-8736-d6c4c3a540cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:29 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Volume 86acedd9-036a-4cc6-a0fe-005da522fc7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86acedd9-036a-4cc6-a0fe-005da522fc7b', 'volume_size': 1}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1755620509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86acedd9-036a-4cc6-a0fe-005da522fc7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347fb505b8ec40878b3b741620f4d250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:13:30Z,use_quota=True,user_id='f5f3640421d4479d95ec1b2c12c56352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Creating volume 86acedd9-036a-4cc6-a0fe-005da522fc7b {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:13:29 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:13:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-86acedd9-036a-4cc6-a0fe-005da522fc7b 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:29 devstack sudo[86269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-86acedd9-036a-4cc6-a0fe-005da522fc7b 1073741824
Apr 29 10:13:29 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:30 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-86acedd9-036a-4cc6-a0fe-005da522fc7b 1073741824" returned: 0 in 0.981s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-86acedd9-036a-4cc6-a0fe-005da522fc7b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:31 devstack sudo[86276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-86acedd9-036a-4cc6-a0fe-005da522fc7b
Apr 29 10:13:31 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:31 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-86acedd9-036a-4cc6-a0fe-005da522fc7b" returned: 0 in 0.627s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:13:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:13:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fcfd37d-136c-4fba-8736-d6c4c3a540cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86acedd9-036a-4cc6-a0fe-005da522fc7b', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0b8bb5-164d-4d99-880e-2095093247d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:31 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Volume volume-86acedd9-036a-4cc6-a0fe-005da522fc7b (86acedd9-036a-4cc6-a0fe-005da522fc7b): created successfully
Apr 29 10:13:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0b8bb5-164d-4d99-880e-2095093247d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Flow 'volume_create_manager' (b286ac30-fdef-400d-add0-8312eb5ce3b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:13:31 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-6942d762-2203-44fd-85f3-2b4dbfe51fec tempest-TaggedBootDevicesTest_v242-560316634 None] Created volume successfully.
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Flow 'volume_create_manager' (ad79a7b7-fcbd-43e5-854e-5aa1e6ef8179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00040a6-5f73-4eba-9c53-562e85c9f24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00040a6-5f73-4eba-9c53-562e85c9f24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-709063350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d305ad2a-b26a-4a00-85b0-b0e2a825db85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347fb505b8ec40878b3b741620f4d250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:13:33Z,use_quota=True,user_id='f5f3640421d4479d95ec1b2c12c56352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a279294-5b10-4a2a-a44f-8fabd0a08eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a279294-5b10-4a2a-a44f-8fabd0a08eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086e1032-1593-428b-a2e5-2f2fded81bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086e1032-1593-428b-a2e5-2f2fded81bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd305ad2a-b26a-4a00-85b0-b0e2a825db85', 'volume_name': 'volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aacfd2b-0809-4b85-b797-0cda5a225b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aacfd2b-0809-4b85-b797-0cda5a225b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81492b58-ce59-4e2b-a7f5-1818bdee760f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:32 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Volume d305ad2a-b26a-4a00-85b0-b0e2a825db85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85', 'volume_size': 1}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-709063350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d305ad2a-b26a-4a00-85b0-b0e2a825db85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347fb505b8ec40878b3b741620f4d250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:13:33Z,use_quota=True,user_id='f5f3640421d4479d95ec1b2c12c56352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Creating volume d305ad2a-b26a-4a00-85b0-b0e2a825db85 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:13:32 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:32 devstack sudo[86284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85 1073741824
Apr 29 10:13:32 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Flow 'volume_create_manager' (9cce6cc9-1034-4797-bd96-485274c2b7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26eaaa6-2932-487c-a02e-c3c0395dbda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26eaaa6-2932-487c-a02e-c3c0395dbda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1030942559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c3ee9d-660e-468a-a02c-7f50bb38247e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b6576dc597424f99efd4f19d94273d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:13:33Z,use_quota=True,user_id='ae50e08647ca4623abef238c243cefe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ad0bc7-d564-4c5f-ad69-c34fa722b778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ad0bc7-d564-4c5f-ad69-c34fa722b778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f9eaa5-f2e2-447a-81de-14dec0ec88e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f9eaa5-f2e2-447a-81de-14dec0ec88e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9c3ee9d-660e-468a-a02c-7f50bb38247e', 'volume_name': 'volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c466fe58-9d94-433b-89db-f35a6119c268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c466fe58-9d94-433b-89db-f35a6119c268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6464b7ee-263b-4c8d-b7e9-b7c1d7500d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:32 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Volume e9c3ee9d-660e-468a-a02c-7f50bb38247e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e', 'volume_size': 1}
Apr 29 10:13:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:13:33 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85 1073741824" returned: 0 in 0.935s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:33 devstack sudo[86290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85
Apr 29 10:13:33 devstack sudo[86290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:34 devstack sudo[86290]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85" returned: 0 in 0.669s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.525s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1030942559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c3ee9d-660e-468a-a02c-7f50bb38247e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b6576dc597424f99efd4f19d94273d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:13:33Z,use_quota=True,user_id='ae50e08647ca4623abef238c243cefe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Creating volume e9c3ee9d-660e-468a-a02c-7f50bb38247e {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:13:34 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81492b58-ce59-4e2b-a7f5-1818bdee760f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916b5a05-a9c1-4078-9a84-d8d3b06832f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:34 devstack sudo[86296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e 1073741824
Apr 29 10:13:34 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:34 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Volume volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85 (d305ad2a-b26a-4a00-85b0-b0e2a825db85): created successfully
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916b5a05-a9c1-4078-9a84-d8d3b06832f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Flow 'volume_create_manager' (ad79a7b7-fcbd-43e5-854e-5aa1e6ef8179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:13:34 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-bf62d4a8-701f-43b4-bb4b-e85f8aea3347 tempest-TaggedBootDevicesTest_v242-560316634 None] Created volume successfully.
Apr 29 10:13:35 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e 1073741824" returned: 0 in 1.024s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:35 devstack sudo[86302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e
Apr 29 10:13:35 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:36 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e" returned: 0 in 0.700s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:13:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:13:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6464b7ee-263b-4c8d-b7e9-b7c1d7500d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c32019-a95f-4001-960f-dec402b5614a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:13:36 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Volume volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e (e9c3ee9d-660e-468a-a02c-7f50bb38247e): created successfully
Apr 29 10:13:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c32019-a95f-4001-960f-dec402b5614a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:13:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Flow 'volume_create_manager' (9cce6cc9-1034-4797-bd96-485274c2b7fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:13:36 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-f2a9a48f-a3e8-4258-b13e-517576fcac94 tempest-TaggedAttachmentsTest-987881948 None] Created volume successfully.
Apr 29 10:13:46 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=49,cinder:UPDATE=22,cinder:INSERT=8,cinder:DELETE=3 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:13:46 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=39,cinder:UPDATE=34,cinder:INSERT=13,cinder:DELETE=2 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:13:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-bf5dda2c-ea2e-4eb8-9665-969b0fff2346 tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:13:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-bf5dda2c-ea2e-4eb8-9665-969b0fff2346 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:13:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d30b18e-0e8a-42f3-acde-fca33ecfe688]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:13:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-bf5dda2c-ea2e-4eb8-9665-969b0fff2346 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:58 devstack sudo[86543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232
Apr 29 10:13:58 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:13:58 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root
Apr 29 10:13:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-bf5dda2c-ea2e-4eb8-9665-969b0fff2346 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232" returned: 0 in 0.766s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:13:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-bf5dda2c-ea2e-4eb8-9665-969b0fff2346 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:13:59 devstack sudo[86547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232
Apr 29 10:13:59 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:14:00 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root
Apr 29 10:14:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-bf5dda2c-ea2e-4eb8-9665-969b0fff2346 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232" returned: 1 in 1.172s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:14:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-bf5dda2c-ea2e-4eb8-9665-969b0fff2346 tempest-TaggedBootDevicesTest_v242-560316634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:14:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-bf5dda2c-ea2e-4eb8-9665-969b0fff2346 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.997s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:14:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-bf5dda2c-ea2e-4eb8-9665-969b0fff2346 tempest-TaggedBootDevicesTest_v242-560316634 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-b872cf00-1938-4fcc-b33c-62c300a10232', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e88af1b5-508e-4fc4-b6b6-9b8d71b26460', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:14:00 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-bf5dda2c-ea2e-4eb8-9665-969b0fff2346 tempest-TaggedBootDevicesTest_v242-560316634 None] attachment_update completed successfully.
Apr 29 10:14:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-1e31dc18-d01c-4b8d-a176-29b6e63e4da5 tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:14:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-1e31dc18-d01c-4b8d-a176-29b6e63e4da5 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:14:02 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[273fabcf-c534-4621-ad75-7edc6162f68b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:14:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-1e31dc18-d01c-4b8d-a176-29b6e63e4da5 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-86acedd9-036a-4cc6-a0fe-005da522fc7b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:14:02 devstack sudo[86763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-86acedd9-036a-4cc6-a0fe-005da522fc7b
Apr 29 10:14:02 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:14:03 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root
Apr 29 10:14:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-1e31dc18-d01c-4b8d-a176-29b6e63e4da5 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-86acedd9-036a-4cc6-a0fe-005da522fc7b" returned: 0 in 0.849s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:14:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-1e31dc18-d01c-4b8d-a176-29b6e63e4da5 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.881s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:14:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-1e31dc18-d01c-4b8d-a176-29b6e63e4da5 tempest-TaggedBootDevicesTest_v242-560316634 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-86acedd9-036a-4cc6-a0fe-005da522fc7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c4cf345-af7c-4a76-8da1-f69f2fa41c6c', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:14:03 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-1e31dc18-d01c-4b8d-a176-29b6e63e4da5 tempest-TaggedBootDevicesTest_v242-560316634 None] attachment_update completed successfully.
Apr 29 10:14:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:14:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:14:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:14:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:14:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:14:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:14:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:14:05 devstack sudo[87261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:14:05 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:14:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-b3523da9-6547-4dfb-9289-757f93c6e2ca tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:14:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-b3523da9-6547-4dfb-9289-757f93c6e2ca tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:14:06 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea600a8-2afe-4f13-bcda-6289b18d85f8]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:14:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-b3523da9-6547-4dfb-9289-757f93c6e2ca tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:14:06 devstack sudo[87289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85
Apr 29 10:14:06 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:14:06 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root
Apr 29 10:14:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.528s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:14:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:14:07 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root
Apr 29 10:14:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-b3523da9-6547-4dfb-9289-757f93c6e2ca tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85" returned: 0 in 1.252s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:14:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-b3523da9-6547-4dfb-9289-757f93c6e2ca tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.331s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:14:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-b3523da9-6547-4dfb-9289-757f93c6e2ca tempest-TaggedBootDevicesTest_v242-560316634 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a6f6873-8881-44b6-8c2d-6209f55e9784', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:14:07 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-c944155d-107a-433c-bfad-2d4eceb5eff1 req-b3523da9-6547-4dfb-9289-757f93c6e2ca tempest-TaggedBootDevicesTest_v242-560316634 None] attachment_update completed successfully.
Apr 29 10:14:17 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=19,cinder:UPDATE=4 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:14:17 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:14:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-f9467fc8-e99d-42f0-aad8-67d09a866365 req-be8e99e8-4b93-42bc-87a4-d43f130613a8 tempest-TaggedAttachmentsTest-987881948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:14:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-f9467fc8-e99d-42f0-aad8-67d09a866365 req-be8e99e8-4b93-42bc-87a4-d43f130613a8 tempest-TaggedAttachmentsTest-987881948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:14:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[060ba5d3-a144-4ae2-bc41-898dedef8505]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:14:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-f9467fc8-e99d-42f0-aad8-67d09a866365 req-be8e99e8-4b93-42bc-87a4-d43f130613a8 tempest-TaggedAttachmentsTest-987881948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:14:44 devstack sudo[87861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e
Apr 29 10:14:44 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:14:46 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root
Apr 29 10:14:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-f9467fc8-e99d-42f0-aad8-67d09a866365 req-be8e99e8-4b93-42bc-87a4-d43f130613a8 tempest-TaggedAttachmentsTest-987881948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e" returned: 0 in 1.568s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:14:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-f9467fc8-e99d-42f0-aad8-67d09a866365 req-be8e99e8-4b93-42bc-87a4-d43f130613a8 tempest-TaggedAttachmentsTest-987881948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.619s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:14:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-f9467fc8-e99d-42f0-aad8-67d09a866365 req-be8e99e8-4b93-42bc-87a4-d43f130613a8 tempest-TaggedAttachmentsTest-987881948 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03b76d3b-1173-4196-a8ee-27e997171b5c', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:14:46 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-f9467fc8-e99d-42f0-aad8-67d09a866365 req-be8e99e8-4b93-42bc-87a4-d43f130613a8 tempest-TaggedAttachmentsTest-987881948 None] attachment_update completed successfully.
Apr 29 10:14:53 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-b58cb1c1-95c7-4919-bede-5bf61104c2b2 req-e119d6e4-e362-4b61-8dbd-7d0d502f2aa6 tempest-TaggedAttachmentsTest-987881948 None] Terminate volume connection completed successfully.
Apr 29 10:14:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-b58cb1c1-95c7-4919-bede-5bf61104c2b2 req-e119d6e4-e362-4b61-8dbd-7d0d502f2aa6 tempest-TaggedAttachmentsTest-987881948 None] Deleting attachment 03b76d3b-1173-4196-a8ee-27e997171b5c. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:15:03 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:15:03 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:15:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:15:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:15:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:15:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:15:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:15:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:15:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:05 devstack sudo[88216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:15:05 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:06 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.755s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:15:12 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Acquiring lock "cinder-e9c3ee9d-660e-468a-a02c-7f50bb38247e-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:15:13 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Lock "cinder-e9c3ee9d-660e-468a-a02c-7f50bb38247e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:15:13 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Acquiring lock "cinder-quobyte-e9c3ee9d-660e-468a-a02c-7f50bb38247e" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:15:13 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Lock "cinder-quobyte-e9c3ee9d-660e-468a-a02c-7f50bb38247e" acquired by "delete_volume" :: waited 0.048s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:15:13 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb661209-85d6-4b17-a29b-3fad36821d94]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:15:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:13 devstack sudo[88433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e
Apr 29 10:15:13 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:14 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e" returned: 0 in 1.538s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:14 devstack sudo[88621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e
Apr 29 10:15:14 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:15 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9c3ee9d-660e-468a-a02c-7f50bb38247e" returned: 0 in 1.096s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Lock "cinder-quobyte-e9c3ee9d-660e-468a-a02c-7f50bb38247e" released by "delete_volume" :: held 2.752s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Created reservations ['297675b7-7ffb-4eef-9859-eb3c62438a05', '2840b0eb-f673-4c32-88be-41e752f62122', '8644f11a-ca70-4b27-b899-90642f834cf3', 'ebd78cd5-e628-4173-8024-33b81d0e1ab3'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:16 devstack sudo[88631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:15:16 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Flow 'volume_create_manager' (42e91216-504e-4617-a74a-72ae43112490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b170d01-50ad-40af-b618-b3818dc966ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b170d01-50ad-40af-b618-b3818dc966ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1671687519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2f8e9f-1c94-4797-94e7-0e43769c0e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3a15d0d1304cc194823e8eb8e7da0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:15:16Z,use_quota=True,user_id='0dec16e2e07a407ab2bc94cb157a9673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af74522-2c29-48b0-8b95-766291a824bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af74522-2c29-48b0-8b95-766291a824bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e9f4c5-0782-4efa-a16c-e0262978deff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e9f4c5-0782-4efa-a16c-e0262978deff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c2f8e9f-1c94-4797-94e7-0e43769c0e76', 'volume_name': 'volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb26403-0bdd-4917-8cc6-38dd556581e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb26403-0bdd-4917-8cc6-38dd556581e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84c7c43-9cc5-441b-b136-92ada564ee00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:15:16 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Volume 8c2f8e9f-1c94-4797-94e7-0e43769c0e76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76', 'volume_size': 1}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1671687519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2f8e9f-1c94-4797-94e7-0e43769c0e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3a15d0d1304cc194823e8eb8e7da0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:15:16Z,use_quota=True,user_id='0dec16e2e07a407ab2bc94cb157a9673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Creating volume 8c2f8e9f-1c94-4797-94e7-0e43769c0e76 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:15:16 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:15:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:16 devstack sudo[88634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76 1073741824
Apr 29 10:15:16 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:17 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.961s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:17 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:15:17 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Deleted volume successfully.
Apr 29 10:15:17 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9dcec822-4739-4e56-8702-2824b1f667af tempest-TaggedAttachmentsTest-987881948 None] Lock "cinder-e9c3ee9d-660e-468a-a02c-7f50bb38247e-delete_volume" released by "delete_volume" :: held 4.092s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:15:17 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76 1073741824" returned: 0 in 1.046s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:17 devstack sudo[88643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76
Apr 29 10:15:17 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:18 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76" returned: 0 in 0.837s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:15:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:15:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84c7c43-9cc5-441b-b136-92ada564ee00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:15:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb62771-8fca-4aac-8d41-8a095accda84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:15:18 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Volume volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76 (8c2f8e9f-1c94-4797-94e7-0e43769c0e76): created successfully
Apr 29 10:15:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb62771-8fca-4aac-8d41-8a095accda84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:15:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Flow 'volume_create_manager' (42e91216-504e-4617-a74a-72ae43112490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:15:18 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5c06a250-2ec0-4805-9925-5597c3d3f6e5 tempest-AttachSCSIVolumeTestJSON-504119459 None] Created volume successfully.
Apr 29 10:15:21 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-0a2b4d60-871c-4a65-8a20-003a3cbba87b req-0ebb93f3-5f56-438d-8ca9-d52799d13b8f tempest-TaggedBootDevicesTest-739208576 None] Terminate volume connection completed successfully.
Apr 29 10:15:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-0a2b4d60-871c-4a65-8a20-003a3cbba87b req-0ebb93f3-5f56-438d-8ca9-d52799d13b8f tempest-TaggedBootDevicesTest-739208576 None] Deleting attachment 29afc4ca-0baa-462a-8175-cac8fe423e7f. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:15:22 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-0a2b4d60-871c-4a65-8a20-003a3cbba87b req-06828693-f2c1-45dd-a56e-38fe9fa4ef09 tempest-TaggedBootDevicesTest-739208576 None] Terminate volume connection completed successfully.
Apr 29 10:15:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-0a2b4d60-871c-4a65-8a20-003a3cbba87b req-06828693-f2c1-45dd-a56e-38fe9fa4ef09 tempest-TaggedBootDevicesTest-739208576 None] Deleting attachment 7ecb25a0-9523-49a0-97ad-962ff8690a56. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:15:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-efcb5e17-ea03-4fd1-a02d-40f9f0a161ef req-497f59c1-9359-461a-956d-95a54a57e1d4 tempest-AttachSCSIVolumeTestJSON-504119459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:15:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-efcb5e17-ea03-4fd1-a02d-40f9f0a161ef req-497f59c1-9359-461a-956d-95a54a57e1d4 tempest-AttachSCSIVolumeTestJSON-504119459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:15:22 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3553288-b439-451a-8ed4-85ff8359956a]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:15:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-efcb5e17-ea03-4fd1-a02d-40f9f0a161ef req-497f59c1-9359-461a-956d-95a54a57e1d4 tempest-AttachSCSIVolumeTestJSON-504119459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:22 devstack sudo[88677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76
Apr 29 10:15:22 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:23 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-0a2b4d60-871c-4a65-8a20-003a3cbba87b req-aeecd79e-f684-408c-a46c-40d4cc985dfc tempest-TaggedBootDevicesTest-739208576 None] Terminate volume connection completed successfully.
Apr 29 10:15:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-0a2b4d60-871c-4a65-8a20-003a3cbba87b req-aeecd79e-f684-408c-a46c-40d4cc985dfc tempest-TaggedBootDevicesTest-739208576 None] Deleting attachment 32c55bc5-ce23-4c0c-983a-aaa95e45f73b. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:15:23 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-efcb5e17-ea03-4fd1-a02d-40f9f0a161ef req-497f59c1-9359-461a-956d-95a54a57e1d4 tempest-AttachSCSIVolumeTestJSON-504119459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76" returned: 0 in 0.965s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-efcb5e17-ea03-4fd1-a02d-40f9f0a161ef req-497f59c1-9359-461a-956d-95a54a57e1d4 tempest-AttachSCSIVolumeTestJSON-504119459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.984s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:15:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-efcb5e17-ea03-4fd1-a02d-40f9f0a161ef req-497f59c1-9359-461a-956d-95a54a57e1d4 tempest-AttachSCSIVolumeTestJSON-504119459 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a86f100-ed04-4414-b244-69c4dfd34152', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:15:23 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-efcb5e17-ea03-4fd1-a02d-40f9f0a161ef req-497f59c1-9359-461a-956d-95a54a57e1d4 tempest-AttachSCSIVolumeTestJSON-504119459 None] attachment_update completed successfully.
Apr 29 10:15:29 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-bf35e43b-04ed-4a79-8246-16834059410a req-e6abfc30-00a0-4438-a493-e2984a35f128 tempest-AttachSCSIVolumeTestJSON-504119459 None] Terminate volume connection completed successfully.
Apr 29 10:15:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-bf35e43b-04ed-4a79-8246-16834059410a req-e6abfc30-00a0-4438-a493-e2984a35f128 tempest-AttachSCSIVolumeTestJSON-504119459 None] Deleting attachment 7a86f100-ed04-4414-b244-69c4dfd34152. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:15:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "cinder-f1c93d46-c86b-4c73-bae2-edfdc19064a4-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:15:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Lock "cinder-f1c93d46-c86b-4c73-bae2-edfdc19064a4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:15:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "cinder-quobyte-f1c93d46-c86b-4c73-bae2-edfdc19064a4" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:15:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Lock "cinder-quobyte-f1c93d46-c86b-4c73-bae2-edfdc19064a4" acquired by "delete_volume" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:15:31 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0711bb0c-0f4e-4f0d-b525-e9142ab01d5c]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:15:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:31 devstack sudo[88695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4
Apr 29 10:15:31 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:31 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4" returned: 0 in 0.794s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:31 devstack sudo[88709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4
Apr 29 10:15:31 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:32 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1c93d46-c86b-4c73-bae2-edfdc19064a4" returned: 0 in 0.726s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Lock "cinder-quobyte-f1c93d46-c86b-4c73-bae2-edfdc19064a4" released by "delete_volume" :: held 1.582s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:15:32 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Created reservations ['fdb3fd09-617f-418e-b3d6-898642de707b', '60aa200d-3a76-4794-899e-f16f7ccb2a48', '19ac7ed1-07c8-4621-9ac4-c24f8eaab76d', '1a567959-47c4-4c17-b60c-721d134ffffa'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:15:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:15:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:15:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:15:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:15:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:15:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:32 devstack sudo[88717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:15:32 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "cinder-bf36d1cb-45c6-4a06-8d31-3289d282f010-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:15:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Lock "cinder-bf36d1cb-45c6-4a06-8d31-3289d282f010-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:15:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "cinder-quobyte-bf36d1cb-45c6-4a06-8d31-3289d282f010" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:15:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Lock "cinder-quobyte-bf36d1cb-45c6-4a06-8d31-3289d282f010" acquired by "delete_volume" :: waited 0.027s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:15:33 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbcca80-247f-4a3c-94db-202b8acbd85b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:15:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bf36d1cb-45c6-4a06-8d31-3289d282f010 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:33 devstack sudo[88719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bf36d1cb-45c6-4a06-8d31-3289d282f010
Apr 29 10:15:33 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:33 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.798s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:33 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:15:33 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Deleted volume successfully.
Apr 29 10:15:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5c78bf7e-bcc9-41de-ba9c-f80469569696 tempest-TaggedBootDevicesTest-739208576 None] Lock "cinder-f1c93d46-c86b-4c73-bae2-edfdc19064a4-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:15:34 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bf36d1cb-45c6-4a06-8d31-3289d282f010" returned: 0 in 1.528s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bf36d1cb-45c6-4a06-8d31-3289d282f010 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:34 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bf36d1cb-45c6-4a06-8d31-3289d282f010
Apr 29 10:15:34 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:35 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bf36d1cb-45c6-4a06-8d31-3289d282f010" returned: 0 in 0.936s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Lock "cinder-quobyte-bf36d1cb-45c6-4a06-8d31-3289d282f010" released by "delete_volume" :: held 2.530s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:15:35 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Created reservations ['c2d6b6ed-0501-4c30-8b05-67a675750dc4', 'af0ce4a1-ba8a-4d5e-9846-61f236b5c78c', 'd5f16814-c998-48b1-8924-c2d6ee97ef0b', '1c64cfd2-a2d1-4783-a3d4-91230be7ce6b'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:15:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:15:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:15:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:15:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:15:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:15:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:36 devstack sudo[89145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:15:36 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:36 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "cinder-1770bfdc-02b9-426e-ad57-8788dceffbff-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:15:36 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Lock "cinder-1770bfdc-02b9-426e-ad57-8788dceffbff-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:15:36 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "cinder-quobyte-1770bfdc-02b9-426e-ad57-8788dceffbff" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:15:36 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Lock "cinder-quobyte-1770bfdc-02b9-426e-ad57-8788dceffbff" acquired by "delete_volume" :: waited 0.028s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:15:36 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.885s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:36 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:15:37 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Deleted volume successfully.
Apr 29 10:15:37 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e5f2f4-e38d-4fd4-855a-06af3f9b84a2]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:15:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:37 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c7262c4d-0968-48ee-825f-eebe009b064a tempest-TaggedBootDevicesTest-739208576 None] Lock "cinder-bf36d1cb-45c6-4a06-8d31-3289d282f010-delete_volume" released by "delete_volume" :: held 3.841s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:15:37 devstack sudo[89155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff
Apr 29 10:15:37 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:37 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff" returned: 0 in 0.920s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:38 devstack sudo[89162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff
Apr 29 10:15:38 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:38 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff" returned: 1 in 0.974s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:15:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:38 devstack sudo[89170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff
Apr 29 10:15:38 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:39 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1770bfdc-02b9-426e-ad57-8788dceffbff" returned: 0 in 0.786s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:39 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Lock "cinder-quobyte-1770bfdc-02b9-426e-ad57-8788dceffbff" released by "delete_volume" :: held 2.773s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:15:39 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Created reservations ['761470bc-e26e-4f31-92de-3b22f624e8d6', '897d3635-c637-4210-9ff0-809914a85ef0', '37733bb6-187f-4f3c-9b77-572f05ec6241', 'ff253da2-923e-49e4-8513-ab7253d16639'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:15:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:15:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:15:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:15:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:15:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:15:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:39 devstack sudo[89174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:15:39 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:40 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.622s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:40 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:15:40 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Deleted volume successfully.
Apr 29 10:15:40 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-22c9bd84-d562-4cbe-ac00-fe6b91c6f8a1 tempest-TaggedBootDevicesTest-739208576 None] Lock "cinder-1770bfdc-02b9-426e-ad57-8788dceffbff-delete_volume" released by "delete_volume" :: held 3.707s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:15:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Acquiring lock "cinder-8c2f8e9f-1c94-4797-94e7-0e43769c0e76-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:15:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Lock "cinder-8c2f8e9f-1c94-4797-94e7-0e43769c0e76-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:15:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Acquiring lock "cinder-quobyte-8c2f8e9f-1c94-4797-94e7-0e43769c0e76" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:15:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Lock "cinder-quobyte-8c2f8e9f-1c94-4797-94e7-0e43769c0e76" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:15:45 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0768e4a4-dfd0-4aee-88f4-3af8d9721389]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:15:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:46 devstack sudo[89186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76
Apr 29 10:15:46 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:46 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76" returned: 0 in 0.834s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:46 devstack sudo[89194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76
Apr 29 10:15:46 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:47 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8c2f8e9f-1c94-4797-94e7-0e43769c0e76" returned: 0 in 0.675s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Lock "cinder-quobyte-8c2f8e9f-1c94-4797-94e7-0e43769c0e76" released by "delete_volume" :: held 1.558s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:15:47 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Created reservations ['6cbab460-e2cc-4712-81ab-2c479ef89484', '3481c80b-3944-49da-a2b8-4abb80a94152', '973d05c6-ba0b-443d-8789-cc23ca6c0090', '96197b53-4eaf-44ee-9125-437cd0aeac62'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:15:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:15:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:15:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:15:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:15:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:15:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:47 devstack sudo[89198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:15:47 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:48 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.926s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:48 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:15:48 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Deleted volume successfully.
Apr 29 10:15:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1a8cf6b3-c656-4987-9600-eff3c8b26805 tempest-AttachSCSIVolumeTestJSON-504119459 None] Lock "cinder-8c2f8e9f-1c94-4797-94e7-0e43769c0e76-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:15:48 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:15:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Flow 'volume_create_manager' (c845759d-e4ff-4d0a-a389-656b342cb614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:15:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed79f4b-27e1-4959-a2d8-b3f2fb0a24ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:15:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed79f4b-27e1-4959-a2d8-b3f2fb0a24ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-29468386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ab11c4-40ed-48c3-ba30-62556d8c43e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a0bd5a7e08241a4ae1c8dfe5d74eed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:15:49Z,use_quota=True,user_id='d738a83f19e24d24a3f9be6ecc1fd814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:15:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e6bc72-1cb8-406b-9c86-6c38fa0892a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:15:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e6bc72-1cb8-406b-9c86-6c38fa0892a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:15:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c680a27-7acd-4f32-be54-1ea5cb235371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:15:48 devstack cinder-volume[84165]: DEBUG cinder.image.glance [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Creating Keystone auth plugin from conf {{(pid=84165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 10:15:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c680a27-7acd-4f32-be54-1ea5cb235371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '70ab11c4-40ed-48c3-ba30-62556d8c43e1', 'volume_name': 'volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52469a3f20>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:15:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8848bb44-b643-44f5-b871-6b1c4774f02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:15:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8848bb44-b643-44f5-b871-6b1c4774f02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:15:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4df1b26-cd12-4c6c-a1f8-48221b1be886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:15:49 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Volume 70ab11c4-40ed-48c3-ba30-62556d8c43e1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52469a3f20>}
Apr 29 10:15:49 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Trying to clone 70ab11c4-40ed-48c3-ba30-62556d8c43e1 from image 718e863a-88e0-4753-95be-273177fb3fd1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]). {{(pid=84165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 29 10:15:49 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-623c007c-15db-421c-8d4d-dd9088408d40 req-1f004db0-dcc1-4fdf-9568-252d12608ffa tempest-TaggedBootDevicesTest_v242-560316634 None] Terminate volume connection completed successfully.
Apr 29 10:15:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-623c007c-15db-421c-8d4d-dd9088408d40 req-1f004db0-dcc1-4fdf-9568-252d12608ffa tempest-TaggedBootDevicesTest_v242-560316634 None] Deleting attachment e88af1b5-508e-4fc4-b6b6-9b8d71b26460. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:15:49 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_l5qg53rkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 10:15:49 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 10:15:49 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e22ce4f-5a88-4a59-a115-dd766d7ae31d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:15:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_l5qg53rkdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:49 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-623c007c-15db-421c-8d4d-dd9088408d40 req-ce674e29-8079-4058-9e14-25cc1ab8d1db tempest-TaggedBootDevicesTest_v242-560316634 None] Terminate volume connection completed successfully.
Apr 29 10:15:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-623c007c-15db-421c-8d4d-dd9088408d40 req-ce674e29-8079-4058-9e14-25cc1ab8d1db tempest-TaggedBootDevicesTest_v242-560316634 None] Deleting attachment 8c4cf345-af7c-4a76-8da1-f69f2fa41c6c. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:15:49 devstack sudo[89204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_l5qg53rkdevstack@QuobyteHD
Apr 29 10:15:49 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:50 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-623c007c-15db-421c-8d4d-dd9088408d40 req-3c8941e2-99fa-48ac-bbfa-0b326e921443 tempest-TaggedBootDevicesTest_v242-560316634 None] Terminate volume connection completed successfully.
Apr 29 10:15:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-623c007c-15db-421c-8d4d-dd9088408d40 req-3c8941e2-99fa-48ac-bbfa-0b326e921443 tempest-TaggedBootDevicesTest_v242-560316634 None] Deleting attachment 7a6f6873-8881-44b6-8c2d-6209f55e9784. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:15:50 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_l5qg53rkdevstack@QuobyteHD" returned: 0 in 0.820s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:50 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 is fetched for user d738a83f19e24d24a3f9be6ecc1fd814. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 10:15:50 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5820c6-9f35-4bf5-83ad-73acbae3931e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:15:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_l5qg53rkdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:50 devstack sudo[89210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_l5qg53rkdevstack@QuobyteHD
Apr 29 10:15:50 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:51 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_l5qg53rkdevstack@QuobyteHD" returned: 0 in 0.775s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:15:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:15:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-29468386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ab11c4-40ed-48c3-ba30-62556d8c43e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a0bd5a7e08241a4ae1c8dfe5d74eed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:15:49Z,use_quota=True,user_id='d738a83f19e24d24a3f9be6ecc1fd814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:15:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Creating volume 70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:15:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:15:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:15:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:15:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:15:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:15:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:15:51 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:15:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:51 devstack sudo[89216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 1073741824
Apr 29 10:15:51 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:52 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 1073741824" returned: 0 in 1.049s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:52 devstack sudo[89223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1
Apr 29 10:15:52 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:53 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1" returned: 0 in 0.783s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:15:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:15:53 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Attempting download of 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume 70ab11c4-40ed-48c3-ba30-62556d8c43e1. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 10:15:53 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[20327ea6-e723-4288-95dd-0ca55a3a10db]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:15:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_gaji2dje {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:53 devstack sudo[89228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_gaji2dje
Apr 29 10:15:53 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:54 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_gaji2dje" returned: 0 in 0.831s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_gaji2dje {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:54 devstack sudo[89232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_gaji2dje
Apr 29 10:15:54 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:55 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_gaji2dje" returned: 1 in 0.768s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_gaji2dje' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:15:55 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[858dadcb-0e78-4410-88ec-79747d439ba9]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:15:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_l5qg53rkdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:55 devstack sudo[89236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_l5qg53rkdevstack@QuobyteHD
Apr 29 10:15:55 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:55 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_l5qg53rkdevstack@QuobyteHD" returned: 0 in 0.906s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:55 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] 718e863a-88e0-4753-95be-273177fb3fd1 was qcow2, converting to raw {{(pid=84165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 10:15:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_l5qg53rkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:56 devstack sudo[89242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_l5qg53rkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1
Apr 29 10:15:56 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:58 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_l5qg53rkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1" returned: 0 in 2.321s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:58 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_l5qg53rkdevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:15:58 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Converted 112.00 MB image at 48.22 MB/s
Apr 29 10:15:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:58 devstack sudo[89250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 1G
Apr 29 10:15:58 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:15:59 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root
Apr 29 10:15:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 1G" returned: 0 in 0.777s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:15:59 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e98209f-a53b-42d6-81cc-fc93edf505bf]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:15:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:15:59 devstack sudo[89257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1
Apr 29 10:15:59 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:16:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "cinder-d305ad2a-b26a-4a00-85b0-b0e2a825db85-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:16:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "cinder-d305ad2a-b26a-4a00-85b0-b0e2a825db85-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:16:00 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root
Apr 29 10:16:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "cinder-quobyte-d305ad2a-b26a-4a00-85b0-b0e2a825db85" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:16:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1" returned: 0 in 1.017s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:16:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:16:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "cinder-quobyte-d305ad2a-b26a-4a00-85b0-b0e2a825db85" acquired by "delete_volume" :: waited 0.039s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:16:00 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c310e40-35af-4603-b069-28cae82808b4]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:16:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:16:00 devstack sudo[89262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1
Apr 29 10:16:00 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:16:00 devstack sudo[89263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85
Apr 29 10:16:00 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:16:01 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root
Apr 29 10:16:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85" returned: 0 in 1.059s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:16:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:16:01 devstack sudo[89272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85
Apr 29 10:16:01 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:16:01 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root
Apr 29 10:16:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1" returned: 1 in 1.167s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:16:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:16:01 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Downloaded image 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume 70ab11c4-40ed-48c3-ba30-62556d8c43e1 successfully. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 10:16:01 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 for user d738a83f19e24d24a3f9be6ecc1fd814 is deleted. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 10:16:01 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Marking volume 70ab11c4-40ed-48c3-ba30-62556d8c43e1 as bootable. {{(pid=84165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 10:16:01 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Copying metadata from image 718e863a-88e0-4753-95be-273177fb3fd1 to 70ab11c4-40ed-48c3-ba30-62556d8c43e1. {{(pid=84165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 10:16:01 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Creating volume glance metadata for volume 70ab11c4-40ed-48c3-ba30-62556d8c43e1 backed by image 718e863a-88e0-4753-95be-273177fb3fd1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 10:16:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4df1b26-cd12-4c6c-a1f8-48221b1be886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52469a3f20>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:16:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8bbe81-b7e5-4400-9093-66dd44c5e82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:16:01 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Volume volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 (70ab11c4-40ed-48c3-ba30-62556d8c43e1): created successfully
Apr 29 10:16:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8bbe81-b7e5-4400-9093-66dd44c5e82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:16:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Flow 'volume_create_manager' (c845759d-e4ff-4d0a-a389-656b342cb614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:16:01 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a3a0809f-6860-4ad2-b926-262c8b9e83d7 tempest-ServerActionsV293TestJSON-295216295 None] Created volume successfully.
Apr 29 10:16:02 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root
Apr 29 10:16:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d305ad2a-b26a-4a00-85b0-b0e2a825db85" returned: 0 in 0.960s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:16:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "cinder-quobyte-d305ad2a-b26a-4a00-85b0-b0e2a825db85" released by "delete_volume" :: held 2.078s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:16:02 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Created reservations ['374e7d3f-36eb-4dea-8422-9c3c7634b590', 'eca544cd-1a25-429c-a1f2-ee0553bb60e9', '6cbb8d8e-0e16-44fd-adca-92465a584732', '767f5b9b-be8c-4226-8889-5665cb46081f'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:16:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:16:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:16:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:16:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:16:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:16:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:16:02 devstack sudo[89276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:16:02 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:16:03 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root
Apr 29 10:16:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.898s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:16:03 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:16:03 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Deleted volume successfully.
Apr 29 10:16:03 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=58,cinder:SELECT=56,cinder:INSERT=22,cinder:DELETE=6 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:16:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9161b78c-1c6f-4759-b00f-fe7a86edee65 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "cinder-d305ad2a-b26a-4a00-85b0-b0e2a825db85-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:16:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "cinder-86acedd9-036a-4cc6-a0fe-005da522fc7b-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:16:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "cinder-86acedd9-036a-4cc6-a0fe-005da522fc7b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:16:03 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=54,cinder:INSERT=17,cinder:UPDATE=57,cinder:DELETE=2 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:16:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "cinder-quobyte-86acedd9-036a-4cc6-a0fe-005da522fc7b" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:16:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "cinder-quobyte-86acedd9-036a-4cc6-a0fe-005da522fc7b" acquired by "delete_volume" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:16:03 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd5ad8c-f794-4598-a463-672905a64b84]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:16:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-86acedd9-036a-4cc6-a0fe-005da522fc7b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:16:03 devstack sudo[89282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-86acedd9-036a-4cc6-a0fe-005da522fc7b
Apr 29 10:16:03 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:16:04 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root
Apr 29 10:16:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-86acedd9-036a-4cc6-a0fe-005da522fc7b" returned: 0 in 1.021s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:16:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-86acedd9-036a-4cc6-a0fe-005da522fc7b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:16:04 devstack sudo[89321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-86acedd9-036a-4cc6-a0fe-005da522fc7b
Apr 29 10:16:04 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:16:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:16:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:16:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:16:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:16:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:16:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:16:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:16:05 devstack sudo[89325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:16:05 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:16:05 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root
Apr 29 10:16:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-86acedd9-036a-4cc6-a0fe-005da522fc7b" returned: 0 in 0.929s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:16:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "cinder-quobyte-86acedd9-036a-4cc6-a0fe-005da522fc7b" released by "delete_volume" :: held 2.014s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:16:05 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Created reservations ['8ca7fdd6-bcd9-484f-ad31-bb58a70c4868', '8a4c2489-efaa-448e-9d4e-84b752855fc3', '9105866b-9571-490e-947d-bea2eb119061', 'a41f61b0-f563-4ea6-ba1d-ec9888a38f6f'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:16:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:16:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:16:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:16:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:16:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:16:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:16:06 devstack sudo[89328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:16:06 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:16:06 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root
Apr 29 10:16:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.966s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:16:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:16:06 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root
Apr 29 10:16:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.804s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:16:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:16:06 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Deleted volume successfully.
Apr 29 10:16:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-72387928-5fcf-445e-ad48-9aa58b0c9ba3 tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "cinder-86acedd9-036a-4cc6-a0fe-005da522fc7b-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:16:07 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "cinder-b872cf00-1938-4fcc-b33c-62c300a10232-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:16:07 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "cinder-b872cf00-1938-4fcc-b33c-62c300a10232-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:16:07 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "cinder-quobyte-b872cf00-1938-4fcc-b33c-62c300a10232" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:16:07 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "cinder-quobyte-b872cf00-1938-4fcc-b33c-62c300a10232" acquired by "delete_volume" :: waited 0.039s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:16:07 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a597ed9f-67c7-4aa3-93ab-870b3afa1f71]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:16:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:16:07 devstack sudo[89332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232
Apr 29 10:16:07 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:16:08 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root
Apr 29 10:16:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232" returned: 0 in 0.824s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:16:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:16:08 devstack sudo[89336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232
Apr 29 10:16:08 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:16:08 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root
Apr 29 10:16:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232" returned: 1 in 0.817s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:16:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:16:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:16:08 devstack sudo[89341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232
Apr 29 10:16:08 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:16:09 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root
Apr 29 10:16:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b872cf00-1938-4fcc-b33c-62c300a10232" returned: 0 in 0.673s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:16:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "cinder-quobyte-b872cf00-1938-4fcc-b33c-62c300a10232" released by "delete_volume" :: held 2.404s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:16:09 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Created reservations ['3281da4a-46e3-4a83-b773-ab7b1c9ed356', '2484add8-9e63-4c0e-8d31-9be2f4a6065a', 'a8f48c02-b042-45e5-8f40-04f8560c8661', 'e3337c0b-c5e7-4049-bea0-bbe0d8550114'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:16:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:16:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:16:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:16:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:16:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:16:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:16:09 devstack sudo[89344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:16:09 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:16:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-aa80aca8-24ec-4c1a-8e92-d6d0eb207764 req-6f1f429d-bc2b-40be-a1fe-f2bf32c357fd tempest-ServerActionsV293TestJSON-295216295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:16:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-aa80aca8-24ec-4c1a-8e92-d6d0eb207764 req-6f1f429d-bc2b-40be-a1fe-f2bf32c357fd tempest-ServerActionsV293TestJSON-295216295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:16:10 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96926dd-545d-46c5-9f30-f55e518fc016]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:16:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-aa80aca8-24ec-4c1a-8e92-d6d0eb207764 req-6f1f429d-bc2b-40be-a1fe-f2bf32c357fd tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:16:10 devstack sudo[89355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1
Apr 29 10:16:10 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:16:10 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root
Apr 29 10:16:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.939s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:16:10 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:16:10 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Deleted volume successfully.
Apr 29 10:16:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c9ae3aee-e97c-4c83-8010-116be6e0fe6d tempest-TaggedBootDevicesTest_v242-560316634 None] Lock "cinder-b872cf00-1938-4fcc-b33c-62c300a10232-delete_volume" released by "delete_volume" :: held 3.626s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:16:11 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root
Apr 29 10:16:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-aa80aca8-24ec-4c1a-8e92-d6d0eb207764 req-6f1f429d-bc2b-40be-a1fe-f2bf32c357fd tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1" returned: 0 in 0.963s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:16:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-aa80aca8-24ec-4c1a-8e92-d6d0eb207764 req-6f1f429d-bc2b-40be-a1fe-f2bf32c357fd tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:16:11 devstack sudo[89361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1
Apr 29 10:16:11 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:16:12 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root
Apr 29 10:16:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-aa80aca8-24ec-4c1a-8e92-d6d0eb207764 req-6f1f429d-bc2b-40be-a1fe-f2bf32c357fd tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1" returned: 1 in 0.947s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:16:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-aa80aca8-24ec-4c1a-8e92-d6d0eb207764 req-6f1f429d-bc2b-40be-a1fe-f2bf32c357fd tempest-ServerActionsV293TestJSON-295216295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:16:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-aa80aca8-24ec-4c1a-8e92-d6d0eb207764 req-6f1f429d-bc2b-40be-a1fe-f2bf32c357fd tempest-ServerActionsV293TestJSON-295216295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.979s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:16:12 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-aa80aca8-24ec-4c1a-8e92-d6d0eb207764 req-6f1f429d-bc2b-40be-a1fe-f2bf32c357fd tempest-ServerActionsV293TestJSON-295216295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e0618d9-5c85-48d4-9021-0ddb20fe55db', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:16:12 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-aa80aca8-24ec-4c1a-8e92-d6d0eb207764 req-6f1f429d-bc2b-40be-a1fe-f2bf32c357fd tempest-ServerActionsV293TestJSON-295216295 None] attachment_update completed successfully.
Apr 29 10:16:22 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=19,cinder:SELECT=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:16:22 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=14,cinder:INSERT=5,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:17:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-737333bc-7269-48c5-81e5-add532cd27bc req-a66790b2-4475-4ffc-859d-096bd66bd08d tempest-ServerActionsV293TestJSON-295216295 None] Terminate volume connection completed successfully.
Apr 29 10:17:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-737333bc-7269-48c5-81e5-add532cd27bc req-a66790b2-4475-4ffc-859d-096bd66bd08d tempest-ServerActionsV293TestJSON-295216295 None] Deleting attachment 3e0618d9-5c85-48d4-9021-0ddb20fe55db. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:17:04 devstack cinder-volume[84165]: DEBUG cinder.image.glance [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Creating Keystone auth plugin from conf {{(pid=84165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 10:17:04 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Attempting download of 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume 70ab11c4-40ed-48c3-ba30-62556d8c43e1. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 10:17:04 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ce2765-e54b-4101-ad25-b810f3432114]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:17:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1uo07_ta {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:04 devstack sudo[90194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1uo07_ta
Apr 29 10:17:04 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:17:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:17:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:17:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:17:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:17:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:17:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:05 devstack sudo[90310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:17:05 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:06 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.508s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:17:07 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1uo07_ta" returned: 0 in 2.372s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1uo07_ta {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:07 devstack sudo[90339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1uo07_ta
Apr 29 10:17:07 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:08 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1uo07_ta" returned: 1 in 1.271s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1uo07_ta' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:17:09 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1uo07_ta, size 20.69 MB, duration 1.00 sec {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 10:17:09 devstack cinder-volume[84165]: INFO cinder.image.image_utils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 10:17:09 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6012d91-c68e-42dc-90d3-3a1b28a5477f]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:17:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1uo07_ta {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:09 devstack sudo[90349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1uo07_ta
Apr 29 10:17:09 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Flow 'volume_create_manager' (08c2dbcd-bfea-4356-9df9-6c94f695991c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a226f5ce-9fdc-4b65-ad15-e93d19248368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:10 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1uo07_ta" returned: 0 in 1.281s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] 718e863a-88e0-4753-95be-273177fb3fd1 was qcow2, converting to raw {{(pid=84165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1uo07_ta /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a226f5ce-9fdc-4b65-ad15-e93d19248368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-471495432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78411a09-8c17-4c34-af57-4ff5374e1f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='240319ef2def49288a7979e88768cf37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:17:10Z,use_quota=True,user_id='8bd41b15fefb45fc93395429558fbdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb2ea0a-d9ee-49e9-a304-08a6c74d68e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb2ea0a-d9ee-49e9-a304-08a6c74d68e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:10 devstack sudo[90355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1uo07_ta /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3fa06d-bc76-4618-aedc-1fefb6a1e349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:10 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3fa06d-bc76-4618-aedc-1fefb6a1e349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78411a09-8c17-4c34-af57-4ff5374e1f2e', 'volume_name': 'volume-78411a09-8c17-4c34-af57-4ff5374e1f2e', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61d1bfa-4a54-489d-8772-4ae714fceae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61d1bfa-4a54-489d-8772-4ae714fceae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca2b81d-be0c-4122-920b-d8b5f9dd85a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:10 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Volume 78411a09-8c17-4c34-af57-4ff5374e1f2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78411a09-8c17-4c34-af57-4ff5374e1f2e', 'volume_size': 1}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-471495432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78411a09-8c17-4c34-af57-4ff5374e1f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='240319ef2def49288a7979e88768cf37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:17:10Z,use_quota=True,user_id='8bd41b15fefb45fc93395429558fbdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Creating volume 78411a09-8c17-4c34-af57-4ff5374e1f2e {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:17:10 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:17:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-78411a09-8c17-4c34-af57-4ff5374e1f2e 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:10 devstack sudo[90357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-78411a09-8c17-4c34-af57-4ff5374e1f2e 1073741824
Apr 29 10:17:10 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:12 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-78411a09-8c17-4c34-af57-4ff5374e1f2e 1073741824" returned: 0 in 1.662s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-78411a09-8c17-4c34-af57-4ff5374e1f2e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:12 devstack sudo[90384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-78411a09-8c17-4c34-af57-4ff5374e1f2e
Apr 29 10:17:12 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:13 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-78411a09-8c17-4c34-af57-4ff5374e1f2e" returned: 0 in 1.355s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] <== create_volume: return (3144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:17:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.152s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:17:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca2b81d-be0c-4122-920b-d8b5f9dd85a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78411a09-8c17-4c34-af57-4ff5374e1f2e', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc1b4ebc-f86d-4285-b20a-525a0fc6e33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:13 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Volume volume-78411a09-8c17-4c34-af57-4ff5374e1f2e (78411a09-8c17-4c34-af57-4ff5374e1f2e): created successfully
Apr 29 10:17:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc1b4ebc-f86d-4285-b20a-525a0fc6e33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Flow 'volume_create_manager' (08c2dbcd-bfea-4356-9df9-6c94f695991c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:17:13 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-21226413-2d97-4538-916d-e825f2fa0bf4 tempest-VolumesAdminNegativeTest-1322198464 None] Created volume successfully.
Apr 29 10:17:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Acquiring lock "cinder-78411a09-8c17-4c34-af57-4ff5374e1f2e-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:17:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Lock "cinder-78411a09-8c17-4c34-af57-4ff5374e1f2e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:17:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Acquiring lock "cinder-quobyte-78411a09-8c17-4c34-af57-4ff5374e1f2e" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:17:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Lock "cinder-quobyte-78411a09-8c17-4c34-af57-4ff5374e1f2e" acquired by "delete_volume" :: waited 0.038s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:17:15 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c916720-1bb7-4c70-95f8-833141f41d93]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:17:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-78411a09-8c17-4c34-af57-4ff5374e1f2e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:15 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-78411a09-8c17-4c34-af57-4ff5374e1f2e
Apr 29 10:17:15 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:16 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1uo07_ta /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1" returned: 0 in 5.901s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:16 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1uo07_ta, size 112.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:17:16 devstack cinder-volume[84165]: INFO cinder.image.image_utils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Converted 112.00 MB image at 18.97 MB/s
Apr 29 10:17:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:16 devstack sudo[90399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 1G
Apr 29 10:17:16 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:16 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-78411a09-8c17-4c34-af57-4ff5374e1f2e" returned: 0 in 1.349s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-78411a09-8c17-4c34-af57-4ff5374e1f2e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:16 devstack sudo[90404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-78411a09-8c17-4c34-af57-4ff5374e1f2e
Apr 29 10:17:16 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Flow 'volume_create_manager' (a8f0c855-7412-41c3-9347-c235f495983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47e8c9b-d325-4a8a-b66e-8564338af289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:17 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 1G" returned: 0 in 1.318s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47e8c9b-d325-4a8a-b66e-8564338af289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1684656549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7ce1c7-a613-4c6b-ba2e-bd908340af92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0824b7bf926f4eb5ac27462db97686bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:17:17Z,use_quota=True,user_id='ffaa2e0367484b92b64684bbbc8dfa29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afccb632-9d25-4c67-a7de-fa8ee0eb6a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afccb632-9d25-4c67-a7de-fa8ee0eb6a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ccdcde-3cbe-432a-86eb-b194a6098e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ccdcde-3cbe-432a-86eb-b194a6098e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a7ce1c7-a613-4c6b-ba2e-bd908340af92', 'volume_name': 'volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bb27f9-3b5a-47f2-9e81-e54abd930a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bb27f9-3b5a-47f2-9e81-e54abd930a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a930f810-bfd3-498e-b3fa-f124b6415c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:17 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Volume 0a7ce1c7-a613-4c6b-ba2e-bd908340af92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92', 'volume_size': 1}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1684656549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7ce1c7-a613-4c6b-ba2e-bd908340af92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0824b7bf926f4eb5ac27462db97686bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:17:17Z,use_quota=True,user_id='ffaa2e0367484b92b64684bbbc8dfa29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Creating volume 0a7ce1c7-a613-4c6b-ba2e-bd908340af92 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:17:17 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7251a122-3222-4c22-8920-4204aff3773b]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:17:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:17 devstack sudo[90409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92 1073741824
Apr 29 10:17:17 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:18 devstack sudo[90410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1
Apr 29 10:17:18 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:18 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-78411a09-8c17-4c34-af57-4ff5374e1f2e" returned: 0 in 1.465s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Lock "cinder-quobyte-78411a09-8c17-4c34-af57-4ff5374e1f2e" released by "delete_volume" :: held 2.965s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:17:18 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Created reservations ['f49f0138-f1bf-4e41-b5c2-68fa00fde015', '9f72192b-1db6-41d6-9580-06208544e9f8', '1094380a-3444-47d3-8e06-2c9468b451a1', '4ebb0c08-ae6b-4218-9334-10bb0a9d34d4'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:17:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:17:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:17:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:17:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:17:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:17:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:18 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92 1073741824" returned: 0 in 1.088s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:18 devstack sudo[90447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:17:18 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:19 devstack sudo[90452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92
Apr 29 10:17:19 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:19 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1" returned: 0 in 1.558s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:19 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1
Apr 29 10:17:19 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:20 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.243s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:20 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:17:20 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Deleted volume successfully.
Apr 29 10:17:20 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-30e3dc23-2435-494d-bf4d-0c032bb29cb2 tempest-VolumesAdminNegativeTest-1322198464 None] Lock "cinder-78411a09-8c17-4c34-af57-4ff5374e1f2e-delete_volume" released by "delete_volume" :: held 4.839s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:17:20 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92" returned: 0 in 1.617s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] <== create_volume: return (2873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:17:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.880s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:17:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a930f810-bfd3-498e-b3fa-f124b6415c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0560de3-eadd-489b-b476-46d75dce5730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:20 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Volume volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92 (0a7ce1c7-a613-4c6b-ba2e-bd908340af92): created successfully
Apr 29 10:17:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0560de3-eadd-489b-b476-46d75dce5730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Flow 'volume_create_manager' (a8f0c855-7412-41c3-9347-c235f495983c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:17:20 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-b877266e-52e0-4297-9503-55a6efa49f45 tempest-ServerActionsTestOtherA-1225156773 None] Created volume successfully.
Apr 29 10:17:20 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1" returned: 1 in 1.539s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:17:20 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Downloaded image 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume 70ab11c4-40ed-48c3-ba30-62556d8c43e1 successfully. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 10:17:20 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Marking volume 70ab11c4-40ed-48c3-ba30-62556d8c43e1 as bootable. {{(pid=84165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 10:17:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Creating volume glance metadata for volume 70ab11c4-40ed-48c3-ba30-62556d8c43e1 backed by image 718e863a-88e0-4753-95be-273177fb3fd1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84165) _refresh_volume_glance_meta /opt/stack/cinder/cinder/volume/manager.py:5408}}
Apr 29 10:17:21 devstack cinder-volume[84165]: DEBUG cinder.compute.nova [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Creating Keystone auth plugin from conf {{(pid=84165) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}}
Apr 29 10:17:21 devstack cinder-volume[84165]: DEBUG novaclient.v2.client [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] REQ: curl -g -i -X POST http://192.168.122.77/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "OpenStack-API-Version: compute 2.93" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3fe280cca848224b5ee74d91025beeb5fb1ff31d519191fc4ea89e151b3cee02" -H "X-OpenStack-Nova-API-Version: 2.93" -H "X-OpenStack-Request-ID: req-737333bc-7269-48c5-81e5-add532cd27bc" -H "X-Service-Token: {SHA256}e23c541e5701b348c8c94de694407ed7c7b55ce56ceacef66e4c87d837095267" -d '{"events": [{"name": "volume-reimaged", "server_uuid": "777e60a0-ea66-47d0-b02f-bc5ec1dbc807", "tag": "70ab11c4-40ed-48c3-ba30-62556d8c43e1"}]}' {{(pid=84165) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}}
Apr 29 10:17:21 devstack cinder-volume[84165]: DEBUG novaclient.v2.client [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 29 Apr 2026 08:17:21 GMT OpenStack-API-Version: compute 2.93 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.93 x-compute-request-id: req-59757a3b-2c4b-4481-9c17-7cb7e149f035 x-openstack-request-id: req-59757a3b-2c4b-4481-9c17-7cb7e149f035 {{(pid=84165) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}}
Apr 29 10:17:21 devstack cinder-volume[84165]: DEBUG novaclient.v2.client [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] RESP BODY: {"events": [{"name": "volume-reimaged", "server_uuid": "777e60a0-ea66-47d0-b02f-bc5ec1dbc807", "tag": "70ab11c4-40ed-48c3-ba30-62556d8c43e1", "status": "completed", "code": 200}]} {{(pid=84165) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}}
Apr 29 10:17:21 devstack cinder-volume[84165]: DEBUG novaclient.v2.client [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] POST call to compute for http://192.168.122.77/compute/v2.1/os-server-external-events used request id req-59757a3b-2c4b-4481-9c17-7cb7e149f035 {{(pid=84165) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}}
Apr 29 10:17:21 devstack cinder-volume[84165]: INFO cinder.compute.nova [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Nova event response: {'name': 'volume-reimaged', 'server_uuid': '777e60a0-ea66-47d0-b02f-bc5ec1dbc807', 'tag': '70ab11c4-40ed-48c3-ba30-62556d8c43e1', 'status': 'completed', 'code': 200}.
Apr 29 10:17:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-737333bc-7269-48c5-81e5-add532cd27bc req-f038b255-c023-4852-8cc3-52cc9d0b2297 tempest-ServerActionsV293TestJSON-295216295 None] Re-imaged 718e863a-88e0-4753-95be-273177fb3fd1 to volume 70ab11c4-40ed-48c3-ba30-62556d8c43e1 successfully. {{(pid=84165) reimage /opt/stack/cinder/cinder/volume/manager.py:5451}}
Apr 29 10:17:22 devstack cinder-volume[84165]: DEBUG oslo_db.sqlalchemy.engines [req-737333bc-7269-48c5-81e5-add532cd27bc req-0d393fd0-1cf5-4e54-bb26-4ff6186ef066 tempest-ServerActionsV293TestJSON-295216295 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84165) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 10:17:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-0d393fd0-1cf5-4e54-bb26-4ff6186ef066 tempest-ServerActionsV293TestJSON-295216295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:17:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-0d393fd0-1cf5-4e54-bb26-4ff6186ef066 tempest-ServerActionsV293TestJSON-295216295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:17:22 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be68381-1c32-4439-8e57-010e3e4e9dca]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:17:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-0d393fd0-1cf5-4e54-bb26-4ff6186ef066 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:22 devstack sudo[90509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1
Apr 29 10:17:22 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:23 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-0d393fd0-1cf5-4e54-bb26-4ff6186ef066 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1" returned: 0 in 0.803s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-0d393fd0-1cf5-4e54-bb26-4ff6186ef066 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:23 devstack sudo[90515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1
Apr 29 10:17:23 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:23 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-0d393fd0-1cf5-4e54-bb26-4ff6186ef066 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1" returned: 1 in 0.748s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-0d393fd0-1cf5-4e54-bb26-4ff6186ef066 tempest-ServerActionsV293TestJSON-295216295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:17:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-737333bc-7269-48c5-81e5-add532cd27bc req-0d393fd0-1cf5-4e54-bb26-4ff6186ef066 tempest-ServerActionsV293TestJSON-295216295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.598s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:17:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-737333bc-7269-48c5-81e5-add532cd27bc req-0d393fd0-1cf5-4e54-bb26-4ff6186ef066 tempest-ServerActionsV293TestJSON-295216295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1cd4ba1-f103-44b6-be6f-773511e47e62', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:17:23 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-737333bc-7269-48c5-81e5-add532cd27bc req-0d393fd0-1cf5-4e54-bb26-4ff6186ef066 tempest-ServerActionsV293TestJSON-295216295 None] attachment_update completed successfully.
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Flow 'volume_create_manager' (9908fb49-91d1-4748-be98-cd0f205ffe28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47da67cd-d9e1-4347-9196-4af2956ae2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47da67cd-d9e1-4347-9196-4af2956ae2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherB-volume-821253639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38d2c9b-3071-4d78-8813-5818c5256e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af39813abf64605bd4798fc2c252740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:17:31Z,use_quota=True,user_id='5e43b3f78cd44e17a8a7b2d679973f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e112a0-7064-4244-b591-0bdc69af3ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e112a0-7064-4244-b591-0bdc69af3ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43b0c07-4c89-499f-a0e5-218c0bb65f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43b0c07-4c89-499f-a0e5-218c0bb65f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f38d2c9b-3071-4d78-8813-5818c5256e20', 'volume_name': 'volume-f38d2c9b-3071-4d78-8813-5818c5256e20', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3805dc7-0a2f-45aa-8846-1e094435a236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3805dc7-0a2f-45aa-8846-1e094435a236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04c568f-d0c6-48e1-a90c-0eb9a0328c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:31 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Volume f38d2c9b-3071-4d78-8813-5818c5256e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f38d2c9b-3071-4d78-8813-5818c5256e20', 'volume_size': 1}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherB-volume-821253639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38d2c9b-3071-4d78-8813-5818c5256e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af39813abf64605bd4798fc2c252740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:17:31Z,use_quota=True,user_id='5e43b3f78cd44e17a8a7b2d679973f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Creating volume f38d2c9b-3071-4d78-8813-5818c5256e20 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:17:31 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:17:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:31 devstack sudo[90984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20 1073741824
Apr 29 10:17:31 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:32 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20 1073741824" returned: 0 in 1.371s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:33 devstack sudo[91001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20
Apr 29 10:17:33 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:33 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20" returned: 0 in 0.941s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] <== create_volume: return (2399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:17:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.402s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:17:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04c568f-d0c6-48e1-a90c-0eb9a0328c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f38d2c9b-3071-4d78-8813-5818c5256e20', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36977d5e-da3a-4000-97b8-cd6ff42a33b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:17:33 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Volume volume-f38d2c9b-3071-4d78-8813-5818c5256e20 (f38d2c9b-3071-4d78-8813-5818c5256e20): created successfully
Apr 29 10:17:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36977d5e-da3a-4000-97b8-cd6ff42a33b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:17:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Flow 'volume_create_manager' (9908fb49-91d1-4748-be98-cd0f205ffe28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:17:34 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-759ae994-30eb-4077-86a5-e05624fd43d4 tempest-ServerActionsTestOtherB-1623996772 None] Created volume successfully.
Apr 29 10:17:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-5e0054dd-1608-4d36-ae2f-86b6cb890674 req-1d2427df-359d-4cb5-8188-97ed10153206 tempest-ServerActionsTestOtherB-1623996772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:17:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-5e0054dd-1608-4d36-ae2f-86b6cb890674 req-1d2427df-359d-4cb5-8188-97ed10153206 tempest-ServerActionsTestOtherB-1623996772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:17:38 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[85857a31-41ca-4b8b-b03d-fffdb16b0f7f]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:17:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-5e0054dd-1608-4d36-ae2f-86b6cb890674 req-1d2427df-359d-4cb5-8188-97ed10153206 tempest-ServerActionsTestOtherB-1623996772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:17:38 devstack sudo[91019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20
Apr 29 10:17:38 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:17:39 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root
Apr 29 10:17:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-5e0054dd-1608-4d36-ae2f-86b6cb890674 req-1d2427df-359d-4cb5-8188-97ed10153206 tempest-ServerActionsTestOtherB-1623996772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20" returned: 0 in 1.443s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:17:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-5e0054dd-1608-4d36-ae2f-86b6cb890674 req-1d2427df-359d-4cb5-8188-97ed10153206 tempest-ServerActionsTestOtherB-1623996772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.470s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:17:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-5e0054dd-1608-4d36-ae2f-86b6cb890674 req-1d2427df-359d-4cb5-8188-97ed10153206 tempest-ServerActionsTestOtherB-1623996772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-f38d2c9b-3071-4d78-8813-5818c5256e20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0e7d2b2-c8da-4a98-ae2b-8270dca0093c', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:17:39 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-5e0054dd-1608-4d36-ae2f-86b6cb890674 req-1d2427df-359d-4cb5-8188-97ed10153206 tempest-ServerActionsTestOtherB-1623996772 None] attachment_update completed successfully.
Apr 29 10:17:49 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=31,cinder:UPDATE=24,cinder:INSERT=9,cinder:DELETE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:17:49 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=29,cinder:UPDATE=20,cinder:INSERT=10,cinder:DELETE=3 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:17:58 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-4203e301-5077-4bff-a5a0-c7b32be0aad8 req-37df3b8f-ab8f-43bd-8b87-939144f6a403 tempest-ServerActionsTestOtherB-1623996772 None] Terminate volume connection completed successfully.
Apr 29 10:17:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-4203e301-5077-4bff-a5a0-c7b32be0aad8 req-37df3b8f-ab8f-43bd-8b87-939144f6a403 tempest-ServerActionsTestOtherB-1623996772 None] Deleting attachment b0e7d2b2-c8da-4a98-ae2b-8270dca0093c. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Flow 'volume_create_manager' (ad4c4f24-fc10-470b-bd6f-ed6cf584b5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c19fc98-6658-4244-94bb-1a99339a5607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c19fc98-6658-4244-94bb-1a99339a5607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1044340073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91f0525-cb32-4702-9029-2ccbf612af92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9196170ca84577b81f57805e21fed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:18:01Z,use_quota=True,user_id='6e3ff5e4cf454b99b6e04ca040075981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae262895-b941-472b-ad42-a9c539350f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae262895-b941-472b-ad42-a9c539350f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c68edee-8590-4ff0-8067-b4274034a556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c68edee-8590-4ff0-8067-b4274034a556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91f0525-cb32-4702-9029-2ccbf612af92', 'volume_name': 'volume-c91f0525-cb32-4702-9029-2ccbf612af92', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9335aa-5220-4007-8a44-e6f9a60070a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9335aa-5220-4007-8a44-e6f9a60070a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53169c43-03f7-42c4-9644-c220493eb5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:18:00 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Volume c91f0525-cb32-4702-9029-2ccbf612af92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91f0525-cb32-4702-9029-2ccbf612af92', 'volume_size': 1}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1044340073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91f0525-cb32-4702-9029-2ccbf612af92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9196170ca84577b81f57805e21fed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:18:01Z,use_quota=True,user_id='6e3ff5e4cf454b99b6e04ca040075981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Creating volume c91f0525-cb32-4702-9029-2ccbf612af92 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:18:00 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:18:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c91f0525-cb32-4702-9029-2ccbf612af92 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:00 devstack sudo[91285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c91f0525-cb32-4702-9029-2ccbf612af92 1073741824
Apr 29 10:18:00 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:01 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c91f0525-cb32-4702-9029-2ccbf612af92 1073741824" returned: 0 in 0.846s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c91f0525-cb32-4702-9029-2ccbf612af92 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:01 devstack sudo[91291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c91f0525-cb32-4702-9029-2ccbf612af92
Apr 29 10:18:01 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:02 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c91f0525-cb32-4702-9029-2ccbf612af92" returned: 0 in 0.822s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:18:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:18:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53169c43-03f7-42c4-9644-c220493eb5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91f0525-cb32-4702-9029-2ccbf612af92', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:18:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57793319-2ef9-46bd-995a-203dd9d734c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:18:02 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Volume volume-c91f0525-cb32-4702-9029-2ccbf612af92 (c91f0525-cb32-4702-9029-2ccbf612af92): created successfully
Apr 29 10:18:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57793319-2ef9-46bd-995a-203dd9d734c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:18:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Flow 'volume_create_manager' (ad4c4f24-fc10-470b-bd6f-ed6cf584b5db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:18:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-62c6073a-2db7-4c4b-b1bb-6673404aba3b tempest-ServerStableDeviceRescueTest-1589463356 None] Created volume successfully.
Apr 29 10:18:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-4203e301-5077-4bff-a5a0-c7b32be0aad8 req-2f2c6e39-8813-4ffd-9724-5ed7f0d9e065 tempest-ServerActionsTestOtherB-1623996772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:18:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-4203e301-5077-4bff-a5a0-c7b32be0aad8 req-2f2c6e39-8813-4ffd-9724-5ed7f0d9e065 tempest-ServerActionsTestOtherB-1623996772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:18:04 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9a00c5-185b-40be-ab06-672f955983ca]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:18:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-4203e301-5077-4bff-a5a0-c7b32be0aad8 req-2f2c6e39-8813-4ffd-9724-5ed7f0d9e065 tempest-ServerActionsTestOtherB-1623996772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:04 devstack sudo[91307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20
Apr 29 10:18:04 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:05 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-4203e301-5077-4bff-a5a0-c7b32be0aad8 req-2f2c6e39-8813-4ffd-9724-5ed7f0d9e065 tempest-ServerActionsTestOtherB-1623996772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20" returned: 0 in 0.764s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-4203e301-5077-4bff-a5a0-c7b32be0aad8 req-2f2c6e39-8813-4ffd-9724-5ed7f0d9e065 tempest-ServerActionsTestOtherB-1623996772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.786s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:18:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-4203e301-5077-4bff-a5a0-c7b32be0aad8 req-2f2c6e39-8813-4ffd-9724-5ed7f0d9e065 tempest-ServerActionsTestOtherB-1623996772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-f38d2c9b-3071-4d78-8813-5818c5256e20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c412454c-f582-40cc-820c-a79deaf1cf4a', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:18:05 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-4203e301-5077-4bff-a5a0-c7b32be0aad8 req-2f2c6e39-8813-4ffd-9724-5ed7f0d9e065 tempest-ServerActionsTestOtherB-1623996772 None] attachment_update completed successfully.
Apr 29 10:18:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:18:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:18:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:18:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:18:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:18:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:18:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:05 devstack sudo[91312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:18:05 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:06 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.578s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:18:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-ab3af6c6-bd92-4240-aaed-c2e529808c0a req-1d2608c8-7c09-4a1b-9b4a-4fdc9a3e56d8 tempest-ServerActionsTestOtherA-1225156773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:18:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-ab3af6c6-bd92-4240-aaed-c2e529808c0a req-1d2608c8-7c09-4a1b-9b4a-4fdc9a3e56d8 tempest-ServerActionsTestOtherA-1225156773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:18:07 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b412639b-0613-4d24-9e32-cfb485441e50]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:18:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-ab3af6c6-bd92-4240-aaed-c2e529808c0a req-1d2608c8-7c09-4a1b-9b4a-4fdc9a3e56d8 tempest-ServerActionsTestOtherA-1225156773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:08 devstack sudo[91369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92
Apr 29 10:18:08 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:08 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-ab3af6c6-bd92-4240-aaed-c2e529808c0a req-1d2608c8-7c09-4a1b-9b4a-4fdc9a3e56d8 tempest-ServerActionsTestOtherA-1225156773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92" returned: 0 in 0.749s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-ab3af6c6-bd92-4240-aaed-c2e529808c0a req-1d2608c8-7c09-4a1b-9b4a-4fdc9a3e56d8 tempest-ServerActionsTestOtherA-1225156773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.765s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:18:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-ab3af6c6-bd92-4240-aaed-c2e529808c0a req-1d2608c8-7c09-4a1b-9b4a-4fdc9a3e56d8 tempest-ServerActionsTestOtherA-1225156773 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'baaf565f-e7a2-44a8-a625-f8cbc4dd2030', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:18:08 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-ab3af6c6-bd92-4240-aaed-c2e529808c0a req-1d2608c8-7c09-4a1b-9b4a-4fdc9a3e56d8 tempest-ServerActionsTestOtherA-1225156773 None] attachment_update completed successfully.
Apr 29 10:18:16 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-4f359477-a846-488e-bd88-983438da0f00 tempest-ServerActionsV293TestJSON-295216295 None] Terminate volume connection completed successfully.
Apr 29 10:18:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-4f359477-a846-488e-bd88-983438da0f00 tempest-ServerActionsV293TestJSON-295216295 None] Deleting attachment a1cd4ba1-f103-44b6-be6f-773511e47e62. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:18:17 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Acquiring lock "cinder-70ab11c4-40ed-48c3-ba30-62556d8c43e1-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:18:17 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Lock "cinder-70ab11c4-40ed-48c3-ba30-62556d8c43e1-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:18:17 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Acquiring lock "cinder-quobyte-70ab11c4-40ed-48c3-ba30-62556d8c43e1" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:18:17 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Lock "cinder-quobyte-70ab11c4-40ed-48c3-ba30-62556d8c43e1" acquired by "delete_volume" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:18:17 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82406e4-b47b-4d2a-be9a-348507bae82a]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:18:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:17 devstack sudo[91629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1
Apr 29 10:18:17 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:18 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-bc10f304-885e-4e67-946d-b61158e045fa req-ce4e58d6-054c-446f-ac83-2ac590b3a66e tempest-ServerActionsTestOtherA-1225156773 None] Terminate volume connection completed successfully.
Apr 29 10:18:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-bc10f304-885e-4e67-946d-b61158e045fa req-ce4e58d6-054c-446f-ac83-2ac590b3a66e tempest-ServerActionsTestOtherA-1225156773 None] Deleting attachment baaf565f-e7a2-44a8-a625-f8cbc4dd2030. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:18:18 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-b3a0bb5e-6d21-4908-891f-0f98edad6d99 req-fcfc0789-a0b9-4f5e-89a9-e34f8065ec3a tempest-ServerActionsTestOtherB-1623996772 None] Terminate volume connection completed successfully.
Apr 29 10:18:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-b3a0bb5e-6d21-4908-891f-0f98edad6d99 req-fcfc0789-a0b9-4f5e-89a9-e34f8065ec3a tempest-ServerActionsTestOtherB-1623996772 None] Deleting attachment c412454c-f582-40cc-820c-a79deaf1cf4a. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:18:19 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1" returned: 0 in 1.807s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:19 devstack sudo[91687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1
Apr 29 10:18:19 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:20 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1" returned: 1 in 1.488s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:18:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:20 devstack sudo[91720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1
Apr 29 10:18:20 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-bc10f304-885e-4e67-946d-b61158e045fa req-8196da18-c98b-4ca8-9401-2aa1e7236ce6 tempest-ServerActionsTestOtherA-1225156773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:18:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-bc10f304-885e-4e67-946d-b61158e045fa req-8196da18-c98b-4ca8-9401-2aa1e7236ce6 tempest-ServerActionsTestOtherA-1225156773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:18:21 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a430317-3ee2-4144-a44b-3b64018377da]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:18:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-bc10f304-885e-4e67-946d-b61158e045fa req-8196da18-c98b-4ca8-9401-2aa1e7236ce6 tempest-ServerActionsTestOtherA-1225156773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:22 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70ab11c4-40ed-48c3-ba30-62556d8c43e1" returned: 0 in 1.190s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:22 devstack sudo[91731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92
Apr 29 10:18:22 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:22 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Lock "cinder-quobyte-70ab11c4-40ed-48c3-ba30-62556d8c43e1" released by "delete_volume" :: held 4.625s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:18:22 devstack cinder-volume[84165]: DEBUG cinder.quota [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Created reservations ['b0a8153d-b67d-47c8-a9a6-33d96d5bf164', '7d2d0775-1ca3-49ca-9ef7-37b3630ce4f4', 'f7951143-15f0-4be3-b53a-f883fc736fb1', '0daa4641-fa38-4dbf-94ae-3340fbe068f1'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:18:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:18:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:18:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:18:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:18:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:18:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:22 devstack sudo[91735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:18:22 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:23 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-bc10f304-885e-4e67-946d-b61158e045fa req-8196da18-c98b-4ca8-9401-2aa1e7236ce6 tempest-ServerActionsTestOtherA-1225156773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92" returned: 0 in 1.297s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-bc10f304-885e-4e67-946d-b61158e045fa req-8196da18-c98b-4ca8-9401-2aa1e7236ce6 tempest-ServerActionsTestOtherA-1225156773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.326s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:18:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-bc10f304-885e-4e67-946d-b61158e045fa req-8196da18-c98b-4ca8-9401-2aa1e7236ce6 tempest-ServerActionsTestOtherA-1225156773 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b1c1bb3-39ac-46c9-b832-24fa3d6e92cd', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:18:23 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-bc10f304-885e-4e67-946d-b61158e045fa req-8196da18-c98b-4ca8-9401-2aa1e7236ce6 tempest-ServerActionsTestOtherA-1225156773 None] attachment_update completed successfully.
Apr 29 10:18:23 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.115s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:23 devstack cinder-volume[84165]: DEBUG cinder.manager [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:18:23 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Deleted volume successfully.
Apr 29 10:18:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-1ae490d0-6013-4a09-b998-ee595794a3f7 req-3232f88c-c2b0-4ba2-a2ec-bce427df91c9 tempest-ServerActionsV293TestJSON-295216295 None] Lock "cinder-70ab11c4-40ed-48c3-ba30-62556d8c43e1-delete_volume" released by "delete_volume" :: held 6.105s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:18:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-b3a0bb5e-6d21-4908-891f-0f98edad6d99 req-5ea80415-fea2-4dc7-b428-e74fa0e5c256 tempest-ServerActionsTestOtherB-1623996772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:18:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-b3a0bb5e-6d21-4908-891f-0f98edad6d99 req-5ea80415-fea2-4dc7-b428-e74fa0e5c256 tempest-ServerActionsTestOtherB-1623996772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:18:27 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d30999-fd82-49a5-bb69-8cc059a8afc2]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:18:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-b3a0bb5e-6d21-4908-891f-0f98edad6d99 req-5ea80415-fea2-4dc7-b428-e74fa0e5c256 tempest-ServerActionsTestOtherB-1623996772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:27 devstack sudo[91841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20
Apr 29 10:18:27 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:28 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-b3a0bb5e-6d21-4908-891f-0f98edad6d99 req-5ea80415-fea2-4dc7-b428-e74fa0e5c256 tempest-ServerActionsTestOtherB-1623996772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20" returned: 0 in 1.093s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-b3a0bb5e-6d21-4908-891f-0f98edad6d99 req-5ea80415-fea2-4dc7-b428-e74fa0e5c256 tempest-ServerActionsTestOtherB-1623996772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.113s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:18:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-b3a0bb5e-6d21-4908-891f-0f98edad6d99 req-5ea80415-fea2-4dc7-b428-e74fa0e5c256 tempest-ServerActionsTestOtherB-1623996772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-f38d2c9b-3071-4d78-8813-5818c5256e20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08a63d93-199b-43ef-82eb-2875fd54ade6', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:18:28 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-b3a0bb5e-6d21-4908-891f-0f98edad6d99 req-5ea80415-fea2-4dc7-b428-e74fa0e5c256 tempest-ServerActionsTestOtherB-1623996772 None] attachment_update completed successfully.
Apr 29 10:18:38 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=35,cinder:UPDATE=17,cinder:INSERT=2 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:18:38 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=31,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=3 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:18:41 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-716a2782-cac7-4b61-92ff-434129ebe852 req-b3595609-be30-40d3-b30c-747cf47d7af2 tempest-ServerActionsTestOtherB-1623996772 None] Terminate volume connection completed successfully.
Apr 29 10:18:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-716a2782-cac7-4b61-92ff-434129ebe852 req-b3595609-be30-40d3-b30c-747cf47d7af2 tempest-ServerActionsTestOtherB-1623996772 None] Deleting attachment 08a63d93-199b-43ef-82eb-2875fd54ade6. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:18:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Acquiring lock "cinder-f38d2c9b-3071-4d78-8813-5818c5256e20-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:18:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Lock "cinder-f38d2c9b-3071-4d78-8813-5818c5256e20-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:18:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Acquiring lock "cinder-quobyte-f38d2c9b-3071-4d78-8813-5818c5256e20" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:18:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Lock "cinder-quobyte-f38d2c9b-3071-4d78-8813-5818c5256e20" acquired by "delete_volume" :: waited 0.024s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:18:45 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0dab42-f4d1-4154-9517-c7898a50d8df]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:18:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:45 devstack sudo[92410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20
Apr 29 10:18:45 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:46 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20" returned: 0 in 0.833s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:46 devstack sudo[92415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20
Apr 29 10:18:46 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:46 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f38d2c9b-3071-4d78-8813-5818c5256e20" returned: 0 in 0.644s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Lock "cinder-quobyte-f38d2c9b-3071-4d78-8813-5818c5256e20" released by "delete_volume" :: held 1.538s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:18:46 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Created reservations ['c7e17c97-519f-4fd7-a99d-1ed0e1794268', '2539ffb9-0311-4bba-898b-b894adcb8515', '5309b23b-9ef1-4566-86a4-4a73657ce17f', 'fe9ce387-8bd1-4818-b7cd-66b93dbacd43'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:18:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:18:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:18:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:18:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:18:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:18:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:46 devstack sudo[92420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:18:46 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:47 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.611s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:47 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:18:47 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Deleted volume successfully.
Apr 29 10:18:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c5253b20-189c-43e7-a8f8-5d814e96d454 tempest-ServerActionsTestOtherB-1623996772 None] Lock "cinder-f38d2c9b-3071-4d78-8813-5818c5256e20-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Flow 'volume_create_manager' (f299a1c6-42f4-47d3-be39-b8e6f0bb0cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1e4c33-0890-4dbc-9076-03b631b40bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1e4c33-0890-4dbc-9076-03b631b40bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1649073442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa1dbd1d-3ff9-433a-84f0-2f411983aafa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0b9e7cd555d34fe29b5f23dff0723ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:18:56Z,use_quota=True,user_id='a7b022e762614777a2f08fe1c9998d22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c1ac1f-4035-4516-995b-98ac76555d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c1ac1f-4035-4516-995b-98ac76555d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ecd3bf-d96e-4024-aec5-070477d3fbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ecd3bf-d96e-4024-aec5-070477d3fbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa1dbd1d-3ff9-433a-84f0-2f411983aafa', 'volume_name': 'volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a8171e-1817-439d-a919-6bd67943b271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a8171e-1817-439d-a919-6bd67943b271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a427a0-0056-4a06-8508-958de53bf31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:18:56 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Volume aa1dbd1d-3ff9-433a-84f0-2f411983aafa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa', 'volume_size': 1}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1649073442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa1dbd1d-3ff9-433a-84f0-2f411983aafa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0b9e7cd555d34fe29b5f23dff0723ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:18:56Z,use_quota=True,user_id='a7b022e762614777a2f08fe1c9998d22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Creating volume aa1dbd1d-3ff9-433a-84f0-2f411983aafa {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:18:56 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:18:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:56 devstack sudo[92493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa 1073741824
Apr 29 10:18:56 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:57 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa 1073741824" returned: 0 in 0.794s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:57 devstack sudo[92501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa
Apr 29 10:18:57 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:57 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa" returned: 0 in 0.620s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:18:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:18:57 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a427a0-0056-4a06-8508-958de53bf31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:18:57 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfae73ca-f49c-49b5-b3c8-7a4add30e37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:18:57 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Volume volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa (aa1dbd1d-3ff9-433a-84f0-2f411983aafa): created successfully
Apr 29 10:18:57 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfae73ca-f49c-49b5-b3c8-7a4add30e37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:18:57 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Flow 'volume_create_manager' (f299a1c6-42f4-47d3-be39-b8e6f0bb0cc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:18:57 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-f1f548ff-3da8-4338-8828-cd7945559cfb req-5e4d22c8-9e10-4ea6-a804-846678afab48 tempest-VolumesGetTestJSON-1350844306 None] Created volume successfully.
Apr 29 10:18:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Acquiring lock "cinder-aa1dbd1d-3ff9-433a-84f0-2f411983aafa-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:18:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Lock "cinder-aa1dbd1d-3ff9-433a-84f0-2f411983aafa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:18:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Acquiring lock "cinder-quobyte-aa1dbd1d-3ff9-433a-84f0-2f411983aafa" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:18:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Lock "cinder-quobyte-aa1dbd1d-3ff9-433a-84f0-2f411983aafa" acquired by "delete_volume" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:18:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a4b0d4-f054-48f8-a2cc-e3202821c17c]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:18:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:58 devstack sudo[92514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa
Apr 29 10:18:58 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-9c7d77dc-d580-4ee3-8f68-cc2d951b6b47 req-63d33560-f0dc-4aa5-b697-9f876ec800aa tempest-ServerStableDeviceRescueTest-1589463356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:18:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-9c7d77dc-d580-4ee3-8f68-cc2d951b6b47 req-63d33560-f0dc-4aa5-b697-9f876ec800aa tempest-ServerStableDeviceRescueTest-1589463356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:18:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1269ff4-ac06-4d19-be06-bcee61f4026e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:18:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-9c7d77dc-d580-4ee3-8f68-cc2d951b6b47 req-63d33560-f0dc-4aa5-b697-9f876ec800aa tempest-ServerStableDeviceRescueTest-1589463356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c91f0525-cb32-4702-9029-2ccbf612af92 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:58 devstack sudo[92517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c91f0525-cb32-4702-9029-2ccbf612af92
Apr 29 10:18:58 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:58 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-c316e892-3b01-48e6-b570-388ca84ef72d req-c053e78f-3ee9-44ac-b391-de222d5e62e6 tempest-ServerActionsTestOtherA-1225156773 None] Terminate volume connection completed successfully.
Apr 29 10:18:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-c316e892-3b01-48e6-b570-388ca84ef72d req-c053e78f-3ee9-44ac-b391-de222d5e62e6 tempest-ServerActionsTestOtherA-1225156773 None] Deleting attachment 2b1c1bb3-39ac-46c9-b832-24fa3d6e92cd. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:18:59 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa" returned: 0 in 0.795s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:18:59 devstack sudo[92537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa
Apr 29 10:18:59 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:18:59 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root
Apr 29 10:18:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-9c7d77dc-d580-4ee3-8f68-cc2d951b6b47 req-63d33560-f0dc-4aa5-b697-9f876ec800aa tempest-ServerStableDeviceRescueTest-1589463356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c91f0525-cb32-4702-9029-2ccbf612af92" returned: 0 in 1.210s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:18:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-9c7d77dc-d580-4ee3-8f68-cc2d951b6b47 req-63d33560-f0dc-4aa5-b697-9f876ec800aa tempest-ServerStableDeviceRescueTest-1589463356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.232s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:18:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-9c7d77dc-d580-4ee3-8f68-cc2d951b6b47 req-63d33560-f0dc-4aa5-b697-9f876ec800aa tempest-ServerStableDeviceRescueTest-1589463356 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-c91f0525-cb32-4702-9029-2ccbf612af92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a5fe255-d94f-469d-b245-d948ed2d2501', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:18:59 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-9c7d77dc-d580-4ee3-8f68-cc2d951b6b47 req-63d33560-f0dc-4aa5-b697-9f876ec800aa tempest-ServerStableDeviceRescueTest-1589463356 None] attachment_update completed successfully.
Apr 29 10:19:00 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-aa1dbd1d-3ff9-433a-84f0-2f411983aafa" returned: 0 in 1.313s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Lock "cinder-quobyte-aa1dbd1d-3ff9-433a-84f0-2f411983aafa" released by "delete_volume" :: held 2.161s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:19:00 devstack cinder-volume[84165]: DEBUG cinder.quota [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Created reservations ['87a7494b-5f4c-4c9c-b649-c20317fa78fa', '82ba3e1a-8b58-4e15-b038-b9bd5a1afdd8', '9a5df985-7ca3-486a-a50a-6eeb2296362a', 'ab76de58-47c7-4cb2-8646-1f71bf9d8653'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:19:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:19:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:19:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:00 devstack sudo[92663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:19:00 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:01 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.922s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:01 devstack cinder-volume[84165]: DEBUG cinder.manager [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:19:01 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Deleted volume successfully.
Apr 29 10:19:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-9c870208-9a28-4cc9-9eac-9ab1153345c2 req-fd4189e9-9f66-48de-ac4e-beaf3e905990 tempest-VolumesGetTestJSON-1350844306 None] Lock "cinder-aa1dbd1d-3ff9-433a-84f0-2f411983aafa-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:19:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:19:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:19:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:19:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:05 devstack sudo[93015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:19:05 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:06 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.030s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:19:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0330d644-211c-49db-956c-66bd4c11dbb4 tempest-BackendsCapabilitiesAdminTestsJSON-995334681 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327003479004, 'free_capacity_gb': 1775.7327003479004, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84165) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 29 10:19:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-69dd89c8-1730-42a3-91ab-5f2157662a23 tempest-BackendsCapabilitiesAdminTestsJSON-995334681 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327003479004, 'free_capacity_gb': 1775.7327003479004, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84165) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 29 10:19:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Acquiring lock "cinder-0a7ce1c7-a613-4c6b-ba2e-bd908340af92-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:19:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Lock "cinder-0a7ce1c7-a613-4c6b-ba2e-bd908340af92-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:19:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Acquiring lock "cinder-quobyte-0a7ce1c7-a613-4c6b-ba2e-bd908340af92" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:19:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Lock "cinder-quobyte-0a7ce1c7-a613-4c6b-ba2e-bd908340af92" acquired by "delete_volume" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:19:09 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cc2919-763e-4266-9b4d-7c471a0620c3]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:19:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:10 devstack sudo[93101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92
Apr 29 10:19:10 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:11 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92" returned: 0 in 1.400s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:11 devstack sudo[93124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92
Apr 29 10:19:11 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:12 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0a7ce1c7-a613-4c6b-ba2e-bd908340af92" returned: 0 in 1.263s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:12 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Lock "cinder-quobyte-0a7ce1c7-a613-4c6b-ba2e-bd908340af92" released by "delete_volume" :: held 2.784s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:19:12 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Created reservations ['d9d13de5-8548-40af-a736-558cc45ecb25', '27a6a2b6-0207-4e3b-abbd-870d6846244b', '735af238-f64e-4410-b2c1-18baa46009a8', '8f849714-27d7-4aac-87f2-3d85d6142f98'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:19:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:12 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:19:12 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:19:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:12 devstack sudo[93128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:19:12 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:14 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.473s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:14 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:19:14 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Deleted volume successfully.
Apr 29 10:19:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-173a3c8b-e791-44d9-b771-9907283b5e27 tempest-ServerActionsTestOtherA-1225156773 None] Lock "cinder-0a7ce1c7-a613-4c6b-ba2e-bd908340af92-delete_volume" released by "delete_volume" :: held 4.668s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:19:16 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-bebacdd1-1978-48b6-a4e7-1c3127f59f3c tempest-GroupSnapshotsTest-1597411933 None] Group tempest-GroupSnapshotsTest-Group-1165495789: creating
Apr 29 10:19:16 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-bebacdd1-1978-48b6-a4e7-1c3127f59f3c tempest-GroupSnapshotsTest-1597411933 None] Group tempest-GroupSnapshotsTest-Group-1165495789: created successfully
Apr 29 10:19:16 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-bebacdd1-1978-48b6-a4e7-1c3127f59f3c tempest-GroupSnapshotsTest-1597411933 None] Create group completed successfully.
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Flow 'volume_create_manager' (96ab4686-c577-4069-a52c-7cbd4ad4e8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91bb8e5-417f-469a-82f9-87ee4e5414d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91bb8e5-417f-469a-82f9-87ee4e5414d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1938367445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=12982a5c-9fbd-4c0d-bcfc-9298326ab84a,host='devstack@QuobyteHD#QuobyteHD',id=9c73b3f5-ad6e-43ba-914a-41b110cd2c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e90f1368f664775b503d7bec45435b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:19:18Z,use_quota=True,user_id='b73d98bf7a724032a6a170379eca907f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c5819c-5854-4acb-a82c-47e18c208d12),volume_type_id=37c5819c-5854-4acb-a82c-47e18c208d12)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f12a81c-8bb8-4c1a-8a63-2f0b2529db67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f12a81c-8bb8-4c1a-8a63-2f0b2529db67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac31c929-c316-464b-b8ec-7a6e5d8388d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac31c929-c316-464b-b8ec-7a6e5d8388d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c73b3f5-ad6e-43ba-914a-41b110cd2c74', 'volume_name': 'volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3104283c-0bbc-4a2f-b81a-4bd19eaf9479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3104283c-0bbc-4a2f-b81a-4bd19eaf9479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5d8df9-3442-4a40-afa0-3f89700d8211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:18 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Volume 9c73b3f5-ad6e-43ba-914a-41b110cd2c74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74', 'volume_size': 1}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=12982a5c-9fbd-4c0d-bcfc-9298326ab84a,created_at=2026-04-29T08:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1938367445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=12982a5c-9fbd-4c0d-bcfc-9298326ab84a,host='devstack@QuobyteHD#QuobyteHD',id=9c73b3f5-ad6e-43ba-914a-41b110cd2c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e90f1368f664775b503d7bec45435b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:19:18Z,use_quota=True,user_id='b73d98bf7a724032a6a170379eca907f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37c5819c-5854-4acb-a82c-47e18c208d12),volume_type_id=37c5819c-5854-4acb-a82c-47e18c208d12)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Creating volume 9c73b3f5-ad6e-43ba-914a-41b110cd2c74 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:19:18 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:19:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:18 devstack sudo[93258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 1073741824
Apr 29 10:19:18 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:19 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 1073741824" returned: 0 in 1.358s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:20 devstack sudo[93334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74
Apr 29 10:19:20 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:20 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74" returned: 0 in 0.692s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] <== create_volume: return (2238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:19:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.240s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5d8df9-3442-4a40-afa0-3f89700d8211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcdd5a03-41d4-442d-bea5-73740c82b5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:20 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Volume volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 (9c73b3f5-ad6e-43ba-914a-41b110cd2c74): created successfully
Apr 29 10:19:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcdd5a03-41d4-442d-bea5-73740c82b5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Flow 'volume_create_manager' (96ab4686-c577-4069-a52c-7cbd4ad4e8f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:19:20 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-bdf14be2-db2e-443a-8fdb-6f633d3edb5a tempest-GroupSnapshotsTest-1597411933 None] Created volume successfully.
Apr 29 10:19:22 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] GroupSnapshot c6bd0aa4-25eb-447a-897c-5368bd3f75ce: creating.
Apr 29 10:19:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] Group snapshot c6bd0aa4-25eb-447a-897c-5368bd3f75ce: creating. {{(pid=84165) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 10:19:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] Creating offline snapshot 77809c42-9048-49c7-82c8-6c149aba22f4 of volume 9c73b3f5-ad6e-43ba-914a-41b110cd2c74 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:19:22 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ecdf12-66a0-40b3-b905-af899db2759f]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:19:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:22 devstack sudo[93365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74
Apr 29 10:19:22 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:23 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74" returned: 0 in 1.242s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:24 devstack sudo[93373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4 1G
Apr 29 10:19:24 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:25 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4 1G" returned: 0 in 1.191s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:25 devstack sudo[93382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4
Apr 29 10:19:25 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:25 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:19:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Flow 'volume_create_manager' (fcd39b53-37be-4c34-ac70-9ab55ab3f2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:19:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e612458-7f95-4a57-a1ae-1831898221a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e612458-7f95-4a57-a1ae-1831898221a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:19:25Z,deleted=False,deleted_at=None,display_description='',display_name='47e0911a-653b-4445-b6c1-7479437472f2-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001aaec9-89f0-42b3-a83f-726b3b331b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b6bd975c064fca9addbfe7c6bd5617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:19:26Z,use_quota=True,user_id='08dc6fb546854355a2658f870a670266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3224977f-113c-4947-be42-5364d9aaf617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3224977f-113c-4947-be42-5364d9aaf617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40af45e-e4c4-48ec-a673-4848f788350b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40af45e-e4c4-48ec-a673-4848f788350b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '001aaec9-89f0-42b3-a83f-726b3b331b02', 'volume_name': 'volume-001aaec9-89f0-42b3-a83f-726b3b331b02', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4a88ab-564d-497c-9fe1-7aec08aab38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4a88ab-564d-497c-9fe1-7aec08aab38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6239043e-7679-43cc-986c-a974486f583d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:25 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Volume 001aaec9-89f0-42b3-a83f-726b3b331b02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-001aaec9-89f0-42b3-a83f-726b3b331b02', 'volume_size': 1}
Apr 29 10:19:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:26 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4" returned: 0 in 1.256s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:26 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 10:19:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:26 devstack sudo[93387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4
Apr 29 10:19:26 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:27 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4" returned: 0 in 1.057s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:27 devstack sudo[93392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.info
Apr 29 10:19:27 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:28 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.info" returned: 0 in 0.835s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:28 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 10:19:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:28 devstack sudo[93397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.info
Apr 29 10:19:28 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:29 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.info" returned: 0 in 1.043s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.771s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.488s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:19:25Z,deleted=False,deleted_at=None,display_description='',display_name='47e0911a-653b-4445-b6c1-7479437472f2-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001aaec9-89f0-42b3-a83f-726b3b331b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b6bd975c064fca9addbfe7c6bd5617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:19:26Z,use_quota=True,user_id='08dc6fb546854355a2658f870a670266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:19:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Creating volume 001aaec9-89f0-42b3-a83f-726b3b331b02 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:19:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:19:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:19:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:19:29 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:19:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-001aaec9-89f0-42b3-a83f-726b3b331b02 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:29 devstack sudo[93436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-001aaec9-89f0-42b3-a83f-726b3b331b02 1073741824
Apr 29 10:19:29 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:29 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-48bbf7f9-c08d-475a-9d44-d8e2794d4318 tempest-GroupSnapshotsTest-1597411933 None] group_snapshot c6bd0aa4-25eb-447a-897c-5368bd3f75ce: created successfully
Apr 29 10:19:30 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-001aaec9-89f0-42b3-a83f-726b3b331b02 1073741824" returned: 0 in 1.426s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-001aaec9-89f0-42b3-a83f-726b3b331b02 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:30 devstack sudo[93504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-001aaec9-89f0-42b3-a83f-726b3b331b02
Apr 29 10:19:31 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:32 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-001aaec9-89f0-42b3-a83f-726b3b331b02" returned: 0 in 1.323s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] <== create_volume: return (2843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.847s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6239043e-7679-43cc-986c-a974486f583d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-001aaec9-89f0-42b3-a83f-726b3b331b02', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3b4224-8763-4ce2-b936-6c4ca8d7a29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:32 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Volume volume-001aaec9-89f0-42b3-a83f-726b3b331b02 (001aaec9-89f0-42b3-a83f-726b3b331b02): created successfully
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3b4224-8763-4ce2-b936-6c4ca8d7a29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Flow 'volume_create_manager' (fcd39b53-37be-4c34-ac70-9ab55ab3f2d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:19:32 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-3854fb27-18bd-4efb-910e-43fa63f5f67b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Created volume successfully.
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "cinder-quobyte-77809c42-9048-49c7-82c8-6c149aba22f4-d46bc64c-7642-447d-a1d4-407c1b0453a6" by "_create_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-77809c42-9048-49c7-82c8-6c149aba22f4-d46bc64c-7642-447d-a1d4-407c1b0453a6" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Creating volume d46bc64c-7642-447d-a1d4-407c1b0453a6 from snapshot 77809c42-9048-49c7-82c8-6c149aba22f4 {{(pid=84165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "cinder-quobyte-d46bc64c-7642-447d-a1d4-407c1b0453a6" by "_copy_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-d46bc64c-7642-447d-a1d4-407c1b0453a6" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] snapshot: 77809c42-9048-49c7-82c8-6c149aba22f4, volume: d46bc64c-7642-447d-a1d4-407c1b0453a6,  {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[929b6dcc-f72f-4fe0-ac05-6b68921018bb]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:19:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:32 devstack sudo[93514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4
Apr 29 10:19:32 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:33 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4" returned: 0 in 0.950s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:19:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 10:19:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Creating direct copy from snapshot {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 10:19:33 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5886d636-8d75-403f-828a-ab3c6f788e06]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:19:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:33 devstack sudo[93520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74
Apr 29 10:19:33 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:34 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74" returned: 0 in 0.955s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:34 devstack cinder-volume[84165]: DEBUG cinder.utils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Path /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d46bc64c-7642-447d-a1d4-407c1b0453a6 not found in is_blk_device check {{(pid=84165) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 10:19:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d46bc64c-7642-447d-a1d4-407c1b0453a6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:34 devstack sudo[93527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d46bc64c-7642-447d-a1d4-407c1b0453a6
Apr 29 10:19:34 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-f2380792-e4cd-45ca-8be0-6a2bd26d804b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:41 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d46bc64c-7642-447d-a1d4-407c1b0453a6" returned: 0 in 7.345s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:41 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc1464b-b36a-4170-88c4-11695bd85814]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:19:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:41 devstack sudo[93561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74
Apr 29 10:19:41 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:43 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74" returned: 0 in 1.170s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:43 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74, size 1024.00 MB, duration 7.35 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d46bc64c-7642-447d-a1d4-407c1b0453a6 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:19:43 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Converted 1024.00 MB image at 139.38 MB/s
Apr 29 10:19:43 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d46bc64c-7642-447d-a1d4-407c1b0453a6 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 10:19:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d46bc64c-7642-447d-a1d4-407c1b0453a6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:43 devstack sudo[93567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d46bc64c-7642-447d-a1d4-407c1b0453a6
Apr 29 10:19:43 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:43 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d46bc64c-7642-447d-a1d4-407c1b0453a6" returned: 0 in 0.735s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-d46bc64c-7642-447d-a1d4-407c1b0453a6" released by "_copy_volume_from_snapshot" :: held 11.295s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:19:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-77809c42-9048-49c7-82c8-6c149aba22f4-d46bc64c-7642-447d-a1d4-407c1b0453a6" released by "_create_volume_from_snapshot" :: held 11.340s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:19:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.376s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-f2380792-e4cd-45ca-8be0-6a2bd26d804b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.811s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:43 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=37,cinder:INSERT=7,cinder:UPDATE=40 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:19:43 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[de99b2df-0463-4e9d-8a2e-4f6c6ec89669]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:19:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-f2380792-e4cd-45ca-8be0-6a2bd26d804b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-001aaec9-89f0-42b3-a83f-726b3b331b02 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:43 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=43,cinder:UPDATE=38,cinder:INSERT=9,cinder:DELETE=6 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:19:43 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-dbb19bff-b2c9-4b1c-bbc5-fac470734da6 tempest-GroupSnapshotsTest-1597411933 None] Create group from source-snapshot-c6bd0aa4-25eb-447a-897c-5368bd3f75ce completed successfully.
Apr 29 10:19:44 devstack sudo[93571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-001aaec9-89f0-42b3-a83f-726b3b331b02
Apr 29 10:19:44 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "cinder-quobyte-d46bc64c-7642-447d-a1d4-407c1b0453a6" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:19:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-d46bc64c-7642-447d-a1d4-407c1b0453a6" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:19:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f24f4a-f8ac-4ddc-baab-d0430ac18508]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:19:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d46bc64c-7642-447d-a1d4-407c1b0453a6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:44 devstack sudo[93578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d46bc64c-7642-447d-a1d4-407c1b0453a6
Apr 29 10:19:44 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:45 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-f2380792-e4cd-45ca-8be0-6a2bd26d804b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-001aaec9-89f0-42b3-a83f-726b3b331b02" returned: 0 in 1.257s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-f2380792-e4cd-45ca-8be0-6a2bd26d804b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.283s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-f2380792-e4cd-45ca-8be0-6a2bd26d804b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-001aaec9-89f0-42b3-a83f-726b3b331b02', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '512ceb02-c308-421d-bee5-55cbad8e62af', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:19:45 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-16fa72e4-8e98-4787-b858-d2853ddf3187 req-f2380792-e4cd-45ca-8be0-6a2bd26d804b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] attachment_update completed successfully.
Apr 29 10:19:45 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d46bc64c-7642-447d-a1d4-407c1b0453a6" returned: 0 in 1.098s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d46bc64c-7642-447d-a1d4-407c1b0453a6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:45 devstack sudo[93600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d46bc64c-7642-447d-a1d4-407c1b0453a6
Apr 29 10:19:45 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:46 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d46bc64c-7642-447d-a1d4-407c1b0453a6" returned: 0 in 0.776s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-d46bc64c-7642-447d-a1d4-407c1b0453a6" released by "delete_volume" :: held 1.946s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:19:46 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Created reservations ['527a4f50-ed1a-4b91-be30-30b2a730d518'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:19:46 devstack cinder-volume[84165]: WARNING cinder.quota [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1843832428 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1843832428, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:19:46 devstack cinder-volume[84165]: WARNING cinder.quota [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1843832428 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1843832428, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:19:46 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Created reservations ['57dd2ed2-5158-43c9-9b96-a35209214ed8', '1cf52835-8900-43a3-b781-d056f4e58aa1', '45f27571-eb80-4463-97b1-251d8cbb908e', 'a4f5fa8b-fe72-4582-8b23-e64fafc89ac1'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:19:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:19:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:19:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:46 devstack sudo[93603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:19:46 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:47 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] group_snapshot c6bd0aa4-25eb-447a-897c-5368bd3f75ce: deleting
Apr 29 10:19:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] group_snapshot c6bd0aa4-25eb-447a-897c-5368bd3f75ce: deleting {{(pid=84165) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 10:19:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "cinder-quobyte-9c73b3f5-ad6e-43ba-914a-41b110cd2c74" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:19:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-9c73b3f5-ad6e-43ba-914a-41b110cd2c74" acquired by "delete_snapshot" :: waited 0.039s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:19:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "cinder-quobyte-77809c42-9048-49c7-82c8-6c149aba22f4" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:19:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-77809c42-9048-49c7-82c8-6c149aba22f4" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:19:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] Deleting offline snapshot 77809c42-9048-49c7-82c8-6c149aba22f4 of volume 9c73b3f5-ad6e-43ba-914a-41b110cd2c74 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:19:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] snapshot_file for this snap is: volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:19:47 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[684e46c6-71d1-4b3b-9413-95f070915bbf]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:19:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:47 devstack sudo[93605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4
Apr 29 10:19:47 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:47 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.822s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:47 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:19:47 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3fb04016-4498-44a4-8d0f-b6c14acc908e tempest-GroupSnapshotsTest-1597411933 None] Delete group completed successfully.
Apr 29 10:19:48 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4" returned: 0 in 0.856s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:19:48 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5f38b5-66b1-4e26-bf72-3f3385b87caa]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:19:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:48 devstack sudo[93611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74
Apr 29 10:19:48 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:49 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74" returned: 0 in 0.803s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:49 devstack sudo[93620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4
Apr 29 10:19:49 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:49 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4" returned: 0 in 0.755s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:49 devstack sudo[93626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4
Apr 29 10:19:49 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:50 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74.77809c42-9048-49c7-82c8-6c149aba22f4" returned: 0 in 0.773s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:50 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-77809c42-9048-49c7-82c8-6c149aba22f4" released by "_delete_snapshot" :: held 3.391s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:19:50 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-9c73b3f5-ad6e-43ba-914a-41b110cd2c74" released by "delete_snapshot" :: held 3.444s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:19:50 devstack cinder-volume[84165]: WARNING cinder.quota [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1843832428 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1843832428, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:19:50 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] Created reservations ['ef89bfa3-7ade-433c-ab9c-a5b757098476', '81b290e5-6f08-4787-99ef-8774efc11b50', 'cd657d4d-75ba-4e12-9940-1f85739628bb', '8965ad8a-cc20-46ca-9f87-e911d207044d'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:19:50 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-24e67833-b344-4d59-a96c-bf880b4c2718 tempest-GroupSnapshotsTest-1597411933 None] group_snapshot c6bd0aa4-25eb-447a-897c-5368bd3f75ce: deleted successfully
Apr 29 10:19:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "cinder-quobyte-9c73b3f5-ad6e-43ba-914a-41b110cd2c74" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:19:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-9c73b3f5-ad6e-43ba-914a-41b110cd2c74" acquired by "delete_volume" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:19:51 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd213ec-ece5-4040-9f9f-d0c48742bbd3]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:19:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:52 devstack sudo[93665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74
Apr 29 10:19:52 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:52 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74" returned: 0 in 0.747s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:52 devstack sudo[93670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74
Apr 29 10:19:52 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:53 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c73b3f5-ad6e-43ba-914a-41b110cd2c74" returned: 0 in 0.617s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-9c73b3f5-ad6e-43ba-914a-41b110cd2c74" released by "delete_volume" :: held 1.470s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:19:53 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Created reservations ['9b223a6d-3200-4753-b80a-adc5312fb88d'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:19:53 devstack cinder-volume[84165]: WARNING cinder.db.sqlalchemy.api [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1843832428']
Apr 29 10:19:53 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Created reservations ['f1ad8e37-be83-442d-86ee-7d9e29149423', 'af8403a4-0a4d-4a47-bd34-afcca7f77070', 'd5c4a706-3287-4362-bfa9-5cdd7be3003f', '54df354a-ee47-4d67-b1ef-525f04266f72'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:19:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:19:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:19:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:53 devstack sudo[93674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:19:53 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:54 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.776s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:54 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:19:54 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-540f436d-ad01-4406-ae19-769bccf5a7c9 tempest-GroupSnapshotsTest-1597411933 None] Delete group completed successfully.
Apr 29 10:19:54 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d698f160-558a-42cc-8f0c-288c6c7e3eae tempest-GroupSnapshotsTest-1597411933 None] Group tempest-GroupSnapshotsTest-Group-1341016062: creating
Apr 29 10:19:54 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d698f160-558a-42cc-8f0c-288c6c7e3eae tempest-GroupSnapshotsTest-1597411933 None] Group tempest-GroupSnapshotsTest-Group-1341016062: created successfully
Apr 29 10:19:54 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d698f160-558a-42cc-8f0c-288c6c7e3eae tempest-GroupSnapshotsTest-1597411933 None] Create group completed successfully.
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Flow 'volume_create_manager' (20d9e2d3-a44e-438d-a0a1-c7ec56a16133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb143482-00a4-4f80-9c85-73530c07d35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb143482-00a4-4f80-9c85-73530c07d35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-756081323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a69a5a2-6fa6-40be-a579-0c9c86eda53c,host='devstack@QuobyteHD#QuobyteHD',id=ec381846-c2a7-4a12-9d9f-0c9f1052d582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e90f1368f664775b503d7bec45435b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:19:56Z,use_quota=True,user_id='b73d98bf7a724032a6a170379eca907f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(def1f477-477d-4b12-b2e9-86540fa9e68f),volume_type_id=def1f477-477d-4b12-b2e9-86540fa9e68f)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c978ae4a-7e4f-4b22-9d8b-a51d2cecaa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c978ae4a-7e4f-4b22-9d8b-a51d2cecaa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8eabf96-260c-422d-89b5-21071748d3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8eabf96-260c-422d-89b5-21071748d3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec381846-c2a7-4a12-9d9f-0c9f1052d582', 'volume_name': 'volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf13d43-c8bd-418f-99ad-95df72049779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf13d43-c8bd-418f-99ad-95df72049779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cf2803-1c42-4c5a-b82c-aa4bc9a352ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:56 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Volume ec381846-c2a7-4a12-9d9f-0c9f1052d582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582', 'volume_size': 1}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6a69a5a2-6fa6-40be-a579-0c9c86eda53c,created_at=2026-04-29T08:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-756081323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a69a5a2-6fa6-40be-a579-0c9c86eda53c,host='devstack@QuobyteHD#QuobyteHD',id=ec381846-c2a7-4a12-9d9f-0c9f1052d582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e90f1368f664775b503d7bec45435b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:19:56Z,use_quota=True,user_id='b73d98bf7a724032a6a170379eca907f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(def1f477-477d-4b12-b2e9-86540fa9e68f),volume_type_id=def1f477-477d-4b12-b2e9-86540fa9e68f)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Creating volume ec381846-c2a7-4a12-9d9f-0c9f1052d582 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:19:56 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:19:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:56 devstack sudo[93680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582 1073741824
Apr 29 10:19:56 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:57 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582 1073741824" returned: 0 in 0.837s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:57 devstack sudo[93702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582
Apr 29 10:19:57 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:57 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582" returned: 0 in 0.631s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:19:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cf2803-1c42-4c5a-b82c-aa4bc9a352ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b17bb0d-3828-40f0-82b9-70dbfc8960c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:58 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Volume volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582 (ec381846-c2a7-4a12-9d9f-0c9f1052d582): created successfully
Apr 29 10:19:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b17bb0d-3828-40f0-82b9-70dbfc8960c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Flow 'volume_create_manager' (20d9e2d3-a44e-438d-a0a1-c7ec56a16133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:19:58 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e2e3abc3-9140-4381-9e6b-7f3d8082bf69 tempest-GroupSnapshotsTest-1597411933 None] Created volume successfully.
Apr 29 10:19:58 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:19:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Flow 'volume_create_manager' (5381b661-a779-49dd-8fa3-7868483f0a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3472c56-6a45-4745-9fca-0858762db10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3472c56-6a45-4745-9fca-0858762db10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1985059842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a69a5a2-6fa6-40be-a579-0c9c86eda53c,host='devstack@QuobyteHD#QuobyteHD',id=6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e90f1368f664775b503d7bec45435b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:19:59Z,use_quota=True,user_id='b73d98bf7a724032a6a170379eca907f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(def1f477-477d-4b12-b2e9-86540fa9e68f),volume_type_id=def1f477-477d-4b12-b2e9-86540fa9e68f)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a471cb-a470-478e-95fe-5542ea66040b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a471cb-a470-478e-95fe-5542ea66040b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c2917d-db15-45ba-a7e3-80794ef78eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c2917d-db15-45ba-a7e3-80794ef78eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677', 'volume_name': 'volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e96bc5d-017c-4122-aee7-9b5151df805b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e96bc5d-017c-4122-aee7-9b5151df805b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec160ff-558d-4b91-ab1f-a7025b337b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:19:59 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Volume 6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677', 'volume_size': 1}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6a69a5a2-6fa6-40be-a579-0c9c86eda53c,created_at=2026-04-29T08:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1985059842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a69a5a2-6fa6-40be-a579-0c9c86eda53c,host='devstack@QuobyteHD#QuobyteHD',id=6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e90f1368f664775b503d7bec45435b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:19:59Z,use_quota=True,user_id='b73d98bf7a724032a6a170379eca907f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(def1f477-477d-4b12-b2e9-86540fa9e68f),volume_type_id=def1f477-477d-4b12-b2e9-86540fa9e68f)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Creating volume 6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:19:59 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:59 devstack sudo[93709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677 1073741824
Apr 29 10:19:59 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:19:59 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677 1073741824" returned: 0 in 0.807s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:19:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:19:59 devstack sudo[93715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677
Apr 29 10:19:59 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:00 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677" returned: 0 in 1.018s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:20:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec160ff-558d-4b91-ab1f-a7025b337b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbac7cff-1c10-4de7-878f-4e743bf3b876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:00 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Volume volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677 (6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677): created successfully
Apr 29 10:20:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbac7cff-1c10-4de7-878f-4e743bf3b876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Flow 'volume_create_manager' (5381b661-a779-49dd-8fa3-7868483f0a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:20:01 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e17fbcec-2b19-458b-b41b-f7c9f6319198 tempest-GroupSnapshotsTest-1597411933 None] Created volume successfully.
Apr 29 10:20:01 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-7f783372-91a3-44b1-8569-ce73764c1be6 tempest-GroupSnapshotsTest-1597411933 None] Update group completed successfully.
Apr 29 10:20:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-17cdce6d-1ce7-4f2d-86d0-146078391498 tempest-GroupSnapshotsTest-1597411933 None] Update group completed successfully.
Apr 29 10:20:03 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1bacd5a7-6b0c-408e-b7f0-c9c246ab25d7 tempest-GroupSnapshotsTest-1597411933 None] Update group completed successfully.
Apr 29 10:20:05 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-1723894d-ad7f-4f46-859d-5f5d6670036d req-2df7c932-8555-4cb3-aac3-18b5ac8bf21d tempest-ServerStableDeviceRescueTest-1589463356 None] Terminate volume connection completed successfully.
Apr 29 10:20:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-1723894d-ad7f-4f46-859d-5f5d6670036d req-2df7c932-8555-4cb3-aac3-18b5ac8bf21d tempest-ServerStableDeviceRescueTest-1589463356 None] Deleting attachment 8a5fe255-d94f-469d-b245-d948ed2d2501. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:20:05 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e5f02290-4344-43bb-bced-ce744902ff4b tempest-GroupSnapshotsTest-1597411933 None] Update group completed successfully.
Apr 29 10:20:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:20:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:20:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:20:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:05 devstack sudo[93872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:20:05 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:06 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.726s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:20:07 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] GroupSnapshot 6e2554aa-1b3e-4803-83d1-3ceeebf38f6d: creating.
Apr 29 10:20:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Group snapshot 6e2554aa-1b3e-4803-83d1-3ceeebf38f6d: creating. {{(pid=84165) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 10:20:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Creating offline snapshot 1d3b5a03-841a-4909-92f4-8803d157876c of volume 6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:20:07 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f0bf55-529d-4e14-9a01-adcba566c495]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:07 devstack sudo[93877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677
Apr 29 10:20:07 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:08 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677" returned: 0 in 1.054s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:08 devstack sudo[93907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c 1G
Apr 29 10:20:08 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:09 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c 1G" returned: 0 in 1.547s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:09 devstack sudo[93988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c
Apr 29 10:20:09 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:10 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c" returned: 0 in 1.173s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:10 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 10:20:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:11 devstack sudo[93996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c
Apr 29 10:20:11 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:11 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c" returned: 0 in 0.865s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:11 devstack sudo[94000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.info
Apr 29 10:20:11 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:12 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.info" returned: 0 in 0.752s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:12 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 10:20:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:12 devstack sudo[94003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.info
Apr 29 10:20:12 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:13 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.info" returned: 0 in 1.071s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.654s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Creating offline snapshot 60d81f5f-84f0-420c-aa76-50301dfbd1bc of volume ec381846-c2a7-4a12-9d9f-0c9f1052d582 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:20:13 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d1748c-2c4b-4127-8eea-e0ab3b5840ee]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:13 devstack sudo[94007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582
Apr 29 10:20:13 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:14 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582" returned: 0 in 1.219s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:15 devstack sudo[94060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc 1G
Apr 29 10:20:15 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:15 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc 1G" returned: 0 in 0.829s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:15 devstack sudo[94067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc
Apr 29 10:20:15 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:16 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc" returned: 0 in 0.720s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:16 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 10:20:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:16 devstack sudo[94072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc
Apr 29 10:20:16 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:17 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc" returned: 0 in 0.785s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:17 devstack sudo[94082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.info
Apr 29 10:20:17 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:18 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.info" returned: 0 in 0.881s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:18 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 10:20:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:18 devstack sudo[94097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.info
Apr 29 10:20:18 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:19 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.info" returned: 0 in 1.022s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.587s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:19 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-9be8a36b-7863-4196-b73c-13825a1022ab tempest-GroupSnapshotsTest-1597411933 None] group_snapshot 6e2554aa-1b3e-4803-83d1-3ceeebf38f6d: created successfully
Apr 29 10:20:19 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Acquiring lock "cinder-c91f0525-cb32-4702-9029-2ccbf612af92-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:20:19 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Lock "cinder-c91f0525-cb32-4702-9029-2ccbf612af92-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:20:19 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Acquiring lock "cinder-quobyte-c91f0525-cb32-4702-9029-2ccbf612af92" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:20:19 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Lock "cinder-quobyte-c91f0525-cb32-4702-9029-2ccbf612af92" acquired by "delete_volume" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:20:19 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca832997-080e-48a6-8f20-fa7abb40d5d6]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c91f0525-cb32-4702-9029-2ccbf612af92 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:19 devstack sudo[94131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c91f0525-cb32-4702-9029-2ccbf612af92
Apr 29 10:20:19 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:20 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] group_snapshot 6e2554aa-1b3e-4803-83d1-3ceeebf38f6d: deleting
Apr 29 10:20:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] group_snapshot 6e2554aa-1b3e-4803-83d1-3ceeebf38f6d: deleting {{(pid=84165) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 10:20:20 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "cinder-quobyte-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:20:20 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:20:20 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "cinder-quobyte-1d3b5a03-841a-4909-92f4-8803d157876c" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:20:20 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-1d3b5a03-841a-4909-92f4-8803d157876c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:20:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Deleting offline snapshot 1d3b5a03-841a-4909-92f4-8803d157876c of volume 6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:20:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] snapshot_file for this snap is: volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:20:20 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd5cfe4-7afe-477c-9492-b1af335d391e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:20 devstack sudo[94157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c
Apr 29 10:20:20 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:21 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c91f0525-cb32-4702-9029-2ccbf612af92" returned: 0 in 1.391s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c91f0525-cb32-4702-9029-2ccbf612af92 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:21 devstack sudo[94186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c91f0525-cb32-4702-9029-2ccbf612af92
Apr 29 10:20:21 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:21 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c" returned: 0 in 1.125s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:20:21 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[df232070-b592-4a70-b966-a53ce18bfe91]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:21 devstack sudo[94192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677
Apr 29 10:20:21 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:22 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c91f0525-cb32-4702-9029-2ccbf612af92" returned: 0 in 0.976s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:22 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Lock "cinder-quobyte-c91f0525-cb32-4702-9029-2ccbf612af92" released by "delete_volume" :: held 2.424s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:20:22 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Created reservations ['ec3084d6-6911-45b6-9100-a226f3fcc7bc', '75a89a00-8c56-43e4-b2c3-b9a4e31290fc', '472b8f62-a513-4de1-a3cd-347389744379', '12fc599e-34e9-4f73-92ec-f25e67350233'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:20:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:20:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:20:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:22 devstack sudo[94196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:20:22 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:22 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677" returned: 0 in 1.476s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:23 devstack sudo[94202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c
Apr 29 10:20:23 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:23 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.012s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:23 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:20:23 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Deleted volume successfully.
Apr 29 10:20:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0d75e87b-5a00-45c8-beb1-171fb7013efb tempest-ServerStableDeviceRescueTest-1589463356 None] Lock "cinder-c91f0525-cb32-4702-9029-2ccbf612af92-delete_volume" released by "delete_volume" :: held 3.882s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:20:24 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c" returned: 0 in 1.437s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:24 devstack sudo[94217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c
Apr 29 10:20:24 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:25 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677.1d3b5a03-841a-4909-92f4-8803d157876c" returned: 0 in 1.449s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:26 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-1d3b5a03-841a-4909-92f4-8803d157876c" released by "_delete_snapshot" :: held 5.861s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:20:26 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677" released by "delete_snapshot" :: held 5.899s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:20:26 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "cinder-quobyte-ec381846-c2a7-4a12-9d9f-0c9f1052d582" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:20:26 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-ec381846-c2a7-4a12-9d9f-0c9f1052d582" acquired by "delete_snapshot" :: waited 0.038s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:20:26 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "cinder-quobyte-60d81f5f-84f0-420c-aa76-50301dfbd1bc" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:20:26 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-60d81f5f-84f0-420c-aa76-50301dfbd1bc" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:20:26 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Deleting offline snapshot 60d81f5f-84f0-420c-aa76-50301dfbd1bc of volume ec381846-c2a7-4a12-9d9f-0c9f1052d582 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:20:26 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] snapshot_file for this snap is: volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:20:26 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8432f69-2919-4a33-8681-0cb6a3061592]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:26 devstack sudo[94300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc
Apr 29 10:20:26 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:27 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc" returned: 0 in 1.109s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:20:27 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfeda9bc-eb20-4dcb-ac2f-9bd23c21865b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:27 devstack sudo[94322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582
Apr 29 10:20:27 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:28 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582" returned: 0 in 1.409s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:28 devstack sudo[94329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc
Apr 29 10:20:28 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:30 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc" returned: 0 in 1.169s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:30 devstack sudo[94335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc
Apr 29 10:20:30 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:30 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582.60d81f5f-84f0-420c-aa76-50301dfbd1bc" returned: 0 in 0.885s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-60d81f5f-84f0-420c-aa76-50301dfbd1bc" released by "_delete_snapshot" :: held 4.773s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:20:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-ec381846-c2a7-4a12-9d9f-0c9f1052d582" released by "delete_snapshot" :: held 4.830s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:20:31 devstack cinder-volume[84165]: WARNING cinder.quota [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1934949483 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1934949483, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:20:31 devstack cinder-volume[84165]: WARNING cinder.quota [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1934949483 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1934949483, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:20:31 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Created reservations ['788c1d10-11a8-4104-853a-ec950df21aa2', '72ef2229-90e7-4d56-99de-d31c4391a91d', '0ca7acd5-ccde-4c7d-8ea5-1da15b9b4727', 'ba08cbf1-7e6b-4fc7-93cc-18e53a7a94a8'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:20:31 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] Created reservations ['d5d45931-2220-4e0f-be7d-3c31dba60f64', 'e17bac52-9a98-4fa8-9813-cbd5b8273139', 'feb29565-a393-4537-aa9b-47b5dd1446db', '0976d3a3-3ec2-44db-808e-9659f6a58064'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:20:31 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a1d81664-6bec-4eac-bc05-944e131d14c2 tempest-GroupSnapshotsTest-1597411933 None] group_snapshot 6e2554aa-1b3e-4803-83d1-3ceeebf38f6d: deleted successfully
Apr 29 10:20:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "cinder-quobyte-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:20:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677" acquired by "delete_volume" :: waited 0.034s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb502299-2f81-4b98-8f40-48873d7b7990]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Flow 'volume_create_manager' (318b316c-7154-437d-9bc8-d0264e8730ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bd6a55-09ee-4dd1-b60f-51a4f0a24079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bd6a55-09ee-4dd1-b60f-51a4f0a24079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-303280989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac67e969c64785badcee246d9f9aa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:20:33Z,use_quota=True,user_id='5b01bf2015644245ba6f8a6ca93339fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0786b379-7f75-4cc0-aa35-cbfda402a057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:33 devstack sudo[94340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677
Apr 29 10:20:33 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0786b379-7f75-4cc0-aa35-cbfda402a057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9bb53d-62cd-4eda-8aab-1e908cb13cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9bb53d-62cd-4eda-8aab-1e908cb13cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb', 'volume_name': 'volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81f9925-8cbf-43a1-a795-9756adc9f824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81f9925-8cbf-43a1-a795-9756adc9f824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d30014f-cc9b-47e1-a4f9-9bd68e109688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:33 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Volume 2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb', 'volume_size': 1}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-303280989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac67e969c64785badcee246d9f9aa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:20:33Z,use_quota=True,user_id='5b01bf2015644245ba6f8a6ca93339fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Creating volume 2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:20:33 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:33 devstack sudo[94342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb 1073741824
Apr 29 10:20:33 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:33 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677" returned: 0 in 0.855s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:34 devstack sudo[94348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677
Apr 29 10:20:34 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:34 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb 1073741824" returned: 0 in 1.291s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:34 devstack sudo[94362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb
Apr 29 10:20:34 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:34 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677" returned: 0 in 1.030s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-6b9cb3f9-cbe1-4dbb-bc5a-1f1e0eb2d677" released by "delete_volume" :: held 2.047s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:20:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "cinder-quobyte-ec381846-c2a7-4a12-9d9f-0c9f1052d582" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:20:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-ec381846-c2a7-4a12-9d9f-0c9f1052d582" acquired by "delete_volume" :: waited 0.034s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:20:35 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5900bdae-7b0e-4bef-806e-91aa1ca476e9]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:35 devstack sudo[94381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582
Apr 29 10:20:35 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:35 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb" returned: 0 in 1.040s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] <== create_volume: return (2398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:20:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.400s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d30014f-cc9b-47e1-a4f9-9bd68e109688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ba061e-79ef-46e0-ac72-3f33ba17a58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:35 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Volume volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb (2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb): created successfully
Apr 29 10:20:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ba061e-79ef-46e0-ac72-3f33ba17a58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Flow 'volume_create_manager' (318b316c-7154-437d-9bc8-d0264e8730ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:20:35 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-29e01979-94bf-4fc1-9c71-f465f763607e tempest-ServersNegativeTestJSON-2121950124 None] Created volume successfully.
Apr 29 10:20:36 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582" returned: 0 in 1.036s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:36 devstack sudo[94389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582
Apr 29 10:20:36 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:37 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ec381846-c2a7-4a12-9d9f-0c9f1052d582" returned: 0 in 1.057s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:37 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-ec381846-c2a7-4a12-9d9f-0c9f1052d582" released by "delete_volume" :: held 2.228s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:20:37 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Created reservations ['492b45bb-0809-4569-a67d-db9d1b8fcaca'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:20:37 devstack cinder-volume[84165]: WARNING cinder.quota [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1934949483 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1934949483, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:20:37 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Created reservations ['72536228-6c59-496d-abb7-83a43d5ca776', '2e14ec2b-11a4-41f0-b0c5-4bab48f3f526', '7c22bb76-9bd5-4d3a-83ff-f05774758068', '1a323957-a21b-458b-be09-4f1de9e22691'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:20:37 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Created reservations ['dde9d4b6-1489-4c54-8a99-0165b457ec25', '4de91c9a-839f-4636-a095-545338013196', 'da6f387c-8aa3-4454-9172-4d10d3164205', '63641eaf-6248-4d82-ab13-9bcf90321dad'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:20:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:20:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:20:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:37 devstack sudo[94392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:20:37 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:38 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c1aa1e92-c476-46ea-9c64-2057d9850f03 tempest-GroupSnapshotsTest-1597411933 None] Group tempest-GroupSnapshotsTest-Group-1181593562: creating
Apr 29 10:20:38 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c1aa1e92-c476-46ea-9c64-2057d9850f03 tempest-GroupSnapshotsTest-1597411933 None] Group tempest-GroupSnapshotsTest-Group-1181593562: created successfully
Apr 29 10:20:39 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c1aa1e92-c476-46ea-9c64-2057d9850f03 tempest-GroupSnapshotsTest-1597411933 None] Create group completed successfully.
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Flow 'volume_create_manager' (366cf0a4-4557-4b4d-81ba-15524390f7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ac9a14-5943-43cf-b1d4-5bc8f6f9b25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:39 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ac9a14-5943-43cf-b1d4-5bc8f6f9b25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1216801159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc90457-6c50-4bc6-bf55-c2a0d9d57360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac67e969c64785badcee246d9f9aa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:20:39Z,use_quota=True,user_id='5b01bf2015644245ba6f8a6ca93339fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e28fd4e-2b0b-4da2-ad7f-ed780b2ea9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e28fd4e-2b0b-4da2-ad7f-ed780b2ea9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a020685-0004-48cb-8a78-f7b0a2b2913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a020685-0004-48cb-8a78-f7b0a2b2913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bc90457-6c50-4bc6-bf55-c2a0d9d57360', 'volume_name': 'volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642b8b3e-d2b9-4094-9867-e2ab4b62bebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642b8b3e-d2b9-4094-9867-e2ab4b62bebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56efca79-3f4c-43d8-87e9-48ac08293c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:39 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Volume 7bc90457-6c50-4bc6-bf55-c2a0d9d57360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360', 'volume_size': 1}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1216801159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc90457-6c50-4bc6-bf55-c2a0d9d57360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfac67e969c64785badcee246d9f9aa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:20:39Z,use_quota=True,user_id='5b01bf2015644245ba6f8a6ca93339fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Creating volume 7bc90457-6c50-4bc6-bf55-c2a0d9d57360 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:20:39 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.485s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:39 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:20:39 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3be2fd63-64fc-40c1-bada-8f59a7022cd5 tempest-GroupSnapshotsTest-1597411933 None] Delete group completed successfully.
Apr 29 10:20:39 devstack sudo[94422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360 1073741824
Apr 29 10:20:39 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:40 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360 1073741824" returned: 0 in 1.133s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:40 devstack sudo[94427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360
Apr 29 10:20:40 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:40 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:20:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Flow 'volume_create_manager' (e9a649d2-c075-4e06-a5c8-1fbd8e63d3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:20:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f131e5-b8bd-4c1a-a48d-44c63d14e9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f131e5-b8bd-4c1a-a48d-44c63d14e9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848634278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ba93559f-0623-4f2d-b38e-8e3e56db5470,host='devstack@QuobyteHD#QuobyteHD',id=58387d83-3f4b-45af-bb54-5407b2d5fae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e90f1368f664775b503d7bec45435b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:20:41Z,use_quota=True,user_id='b73d98bf7a724032a6a170379eca907f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b223dc8-da7d-4c0e-8bc8-0ea54a0bba5e),volume_type_id=2b223dc8-da7d-4c0e-8bc8-0ea54a0bba5e)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ee8c8e-9b46-49bb-ac1d-d6912b1bd43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ee8c8e-9b46-49bb-ac1d-d6912b1bd43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5339cc-a00b-4f36-989c-1453ceeb80b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5339cc-a00b-4f36-989c-1453ceeb80b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58387d83-3f4b-45af-bb54-5407b2d5fae4', 'volume_name': 'volume-58387d83-3f4b-45af-bb54-5407b2d5fae4', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cc02c7-02ff-44fa-b15e-203a25e7f0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cc02c7-02ff-44fa-b15e-203a25e7f0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578168c2-d330-4704-918e-0258a12ede09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:40 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Volume 58387d83-3f4b-45af-bb54-5407b2d5fae4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58387d83-3f4b-45af-bb54-5407b2d5fae4', 'volume_size': 1}
Apr 29 10:20:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:41 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360" returned: 0 in 0.757s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ba93559f-0623-4f2d-b38e-8e3e56db5470,created_at=2026-04-29T08:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848634278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ba93559f-0623-4f2d-b38e-8e3e56db5470,host='devstack@QuobyteHD#QuobyteHD',id=58387d83-3f4b-45af-bb54-5407b2d5fae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e90f1368f664775b503d7bec45435b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:20:41Z,use_quota=True,user_id='b73d98bf7a724032a6a170379eca907f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b223dc8-da7d-4c0e-8bc8-0ea54a0bba5e),volume_type_id=2b223dc8-da7d-4c0e-8bc8-0ea54a0bba5e)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Creating volume 58387d83-3f4b-45af-bb54-5407b2d5fae4 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:20:41 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56efca79-3f4c-43d8-87e9-48ac08293c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7206a8-813a-4c55-813b-46b02c196241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:41 devstack sudo[94430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4 1073741824
Apr 29 10:20:41 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:41 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Volume volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360 (7bc90457-6c50-4bc6-bf55-c2a0d9d57360): created successfully
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7206a8-813a-4c55-813b-46b02c196241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Flow 'volume_create_manager' (366cf0a4-4557-4b4d-81ba-15524390f7eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:20:41 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e1264f5b-b1dc-44e6-be7b-6e7ec8cf60fd tempest-ServersNegativeTestJSON-2121950124 None] Created volume successfully.
Apr 29 10:20:42 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4 1073741824" returned: 0 in 0.935s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:42 devstack sudo[94436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4
Apr 29 10:20:42 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:43 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4" returned: 0 in 0.887s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:20:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578168c2-d330-4704-918e-0258a12ede09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58387d83-3f4b-45af-bb54-5407b2d5fae4', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbefe65-4619-458d-9361-3d037ff6e3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Acquiring lock "cinder-7bc90457-6c50-4bc6-bf55-c2a0d9d57360-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:20:43 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Volume volume-58387d83-3f4b-45af-bb54-5407b2d5fae4 (58387d83-3f4b-45af-bb54-5407b2d5fae4): created successfully
Apr 29 10:20:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbefe65-4619-458d-9361-3d037ff6e3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Flow 'volume_create_manager' (e9a649d2-c075-4e06-a5c8-1fbd8e63d3cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:20:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Lock "cinder-7bc90457-6c50-4bc6-bf55-c2a0d9d57360-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:20:43 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-87b6743e-8387-4227-a79f-076a3b4e9a5e tempest-GroupSnapshotsTest-1597411933 None] Created volume successfully.
Apr 29 10:20:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Acquiring lock "cinder-quobyte-7bc90457-6c50-4bc6-bf55-c2a0d9d57360" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:20:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Lock "cinder-quobyte-7bc90457-6c50-4bc6-bf55-c2a0d9d57360" acquired by "delete_volume" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:20:43 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b8ca25-2e73-4fdc-9ecb-0abdf8079f19]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:43 devstack sudo[94442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360
Apr 29 10:20:43 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:44 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360" returned: 0 in 0.842s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:44 devstack sudo[94447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360
Apr 29 10:20:44 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:44 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] GroupSnapshot 2204de65-6ffb-46a8-bdce-5927278940d1: creating.
Apr 29 10:20:44 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=85,cinder:UPDATE=100,cinder:INSERT=20,cinder:DELETE=4 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:20:44 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=86,cinder:SELECT=105,cinder:INSERT=22,cinder:DELETE=2 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:20:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] Group snapshot 2204de65-6ffb-46a8-bdce-5927278940d1: creating. {{(pid=84165) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 10:20:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] Creating offline snapshot 07662829-4eb8-493d-99db-1d9f3bce8f79 of volume 58387d83-3f4b-45af-bb54-5407b2d5fae4 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:20:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21fece3-4a2f-4c02-b02f-72e0b5ce4867]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:44 devstack sudo[94449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4
Apr 29 10:20:44 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:45 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7bc90457-6c50-4bc6-bf55-c2a0d9d57360" returned: 0 in 0.935s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Lock "cinder-quobyte-7bc90457-6c50-4bc6-bf55-c2a0d9d57360" released by "delete_volume" :: held 1.844s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Created reservations ['a81692ad-430c-4d38-9c70-fa61f1a73ebd', '4569662c-e6ee-490c-a15d-2274fd1e2ff6', '40d148d7-d616-4029-bbe9-c20fd0ae71b4', '63fbecc3-1333-4dfb-a876-edcd2b5d9954'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:45 devstack sudo[94455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:20:45 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:45 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4" returned: 0 in 0.968s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:45 devstack sudo[94457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79 1G
Apr 29 10:20:45 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Acquiring lock "cinder-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Lock "cinder-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Acquiring lock "cinder-quobyte-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Lock "cinder-quobyte-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb" acquired by "delete_volume" :: waited 0.024s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1a1fc5-40b4-4888-b8de-5c5a7b2c7bf6]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:46 devstack sudo[94459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb
Apr 29 10:20:46 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:46 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.861s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:46 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:20:46 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Deleted volume successfully.
Apr 29 10:20:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-66e6455b-a37f-49a2-9d1c-826fa0d50192 tempest-ServersNegativeTestJSON-2121950124 None] Lock "cinder-7bc90457-6c50-4bc6-bf55-c2a0d9d57360-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:20:46 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79 1G" returned: 0 in 1.145s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58387d83-3f4b-45af-bb54-5407b2d5fae4 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:46 devstack sudo[94469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58387d83-3f4b-45af-bb54-5407b2d5fae4 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79
Apr 29 10:20:46 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:46 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb" returned: 0 in 1.046s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:47 devstack sudo[94473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb
Apr 29 10:20:47 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:47 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58387d83-3f4b-45af-bb54-5407b2d5fae4 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79" returned: 0 in 1.045s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:47 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 10:20:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:47 devstack sudo[94479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79
Apr 29 10:20:47 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb" returned: 0 in 1.190s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:48 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Lock "cinder-quobyte-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb" released by "delete_volume" :: held 2.329s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:20:48 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Created reservations ['9595e288-af68-4c42-a9f3-4cb38ff4a7e4', '0d2cf7a0-fb67-4480-97e7-3c36a16ab499', 'd0192f54-9789-4f5e-9dd8-f839a70ef155', 'c06c53b2-9ffb-4d77-8a5c-692144d05242'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:20:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:20:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:20:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:48 devstack sudo[94484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:20:48 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:48 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79" returned: 0 in 1.204s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:49 devstack sudo[94488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.info
Apr 29 10:20:49 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:49 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.988s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:49 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:20:49 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Deleted volume successfully.
Apr 29 10:20:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0e385773-af35-48d3-974c-4eba53e03704 tempest-ServersNegativeTestJSON-2121950124 None] Lock "cinder-2cc2536a-9668-4c00-9ee3-9bbd2c01aeeb-delete_volume" released by "delete_volume" :: held 3.831s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:20:50 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.info" returned: 0 in 1.122s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:50 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 10:20:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:50 devstack sudo[94492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.info
Apr 29 10:20:50 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:50 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:20:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Flow 'volume_create_manager' (94f12f53-e5b3-4be4-98ce-83ade88cf0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:20:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a994f18a-9f95-42d2-be4c-441126618080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a994f18a-9f95-42d2-be4c-441126618080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:20:50Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0f061d-0c5c-49ef-a070-854246adbdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b6bd975c064fca9addbfe7c6bd5617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:20:51Z,use_quota=True,user_id='08dc6fb546854355a2658f870a670266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6128247-140f-404b-bf9f-0aff765bfa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6128247-140f-404b-bf9f-0aff765bfa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166b113f-0518-42aa-8ea7-045848c395f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:50 devstack cinder-volume[84165]: DEBUG cinder.image.glance [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Creating Keystone auth plugin from conf {{(pid=84165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 10:20:50 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.info" returned: 0 in 0.886s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.592s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:51 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a26d6da3-89b0-40fa-817b-4de7ce9aaea6 tempest-GroupSnapshotsTest-1597411933 None] group_snapshot 2204de65-6ffb-46a8-bdce-5927278940d1: created successfully
Apr 29 10:20:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166b113f-0518-42aa-8ea7-045848c395f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eb0f061d-0c5c-49ef-a070-854246adbdac', 'volume_name': 'volume-eb0f061d-0c5c-49ef-a070-854246adbdac', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52469a07d0>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcab614-ae95-45bc-afe0-9b2951d14401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcab614-ae95-45bc-afe0-9b2951d14401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:20:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd24e2a-acfc-4d2f-b6e6-aef7f313722d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:20:51 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Volume eb0f061d-0c5c-49ef-a070-854246adbdac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eb0f061d-0c5c-49ef-a070-854246adbdac', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52469a07d0>}
Apr 29 10:20:51 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Trying to clone eb0f061d-0c5c-49ef-a070-854246adbdac from image 718e863a-88e0-4753-95be-273177fb3fd1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]). {{(pid=84165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 29 10:20:51 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_eg0eo7bsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 10:20:51 devstack cinder-volume[84165]: INFO cinder.image.image_utils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 10:20:51 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e934762c-b377-4f48-b681-52dcbcb2d2c5]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_eg0eo7bsdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:51 devstack sudo[94546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_eg0eo7bsdevstack@QuobyteHD
Apr 29 10:20:51 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:52 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] group_snapshot 2204de65-6ffb-46a8-bdce-5927278940d1: deleting
Apr 29 10:20:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] group_snapshot 2204de65-6ffb-46a8-bdce-5927278940d1: deleting {{(pid=84165) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 10:20:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "cinder-quobyte-58387d83-3f4b-45af-bb54-5407b2d5fae4" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:20:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-58387d83-3f4b-45af-bb54-5407b2d5fae4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:20:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "cinder-quobyte-07662829-4eb8-493d-99db-1d9f3bce8f79" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:20:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-07662829-4eb8-493d-99db-1d9f3bce8f79" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:20:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] Deleting offline snapshot 07662829-4eb8-493d-99db-1d9f3bce8f79 of volume 58387d83-3f4b-45af-bb54-5407b2d5fae4 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:20:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] snapshot_file for this snap is: volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:20:52 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[667c3fc9-e893-457a-988a-cdc2f141d001]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:52 devstack sudo[94553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79
Apr 29 10:20:52 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:52 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_eg0eo7bsdevstack@QuobyteHD" returned: 0 in 1.171s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:52 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 is fetched for user 08dc6fb546854355a2658f870a670266. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 10:20:52 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[400b40e6-95a0-4c51-be94-72822ca2a019]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_eg0eo7bsdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:53 devstack sudo[94561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_eg0eo7bsdevstack@QuobyteHD
Apr 29 10:20:53 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:53 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79" returned: 0 in 1.241s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58387d83-3f4b-45af-bb54-5407b2d5fae4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:20:53 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[073612b1-9163-4012-9946-9863feb24b08]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:53 devstack sudo[94568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4
Apr 29 10:20:53 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:54 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_eg0eo7bsdevstack@QuobyteHD" returned: 0 in 1.376s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:20:50Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0f061d-0c5c-49ef-a070-854246adbdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b6bd975c064fca9addbfe7c6bd5617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:20:51Z,use_quota=True,user_id='08dc6fb546854355a2658f870a670266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:20:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Creating volume eb0f061d-0c5c-49ef-a070-854246adbdac {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:20:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:20:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:20:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:20:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:20:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:20:54 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:20:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:54 devstack sudo[94573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac 1073741824
Apr 29 10:20:54 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:54 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4" returned: 0 in 0.989s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:54 devstack sudo[94582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79
Apr 29 10:20:54 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:55 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79" returned: 0 in 1.066s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:55 devstack sudo[94609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79
Apr 29 10:20:55 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:55 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac 1073741824" returned: 0 in 1.446s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:55 devstack sudo[94611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac
Apr 29 10:20:55 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:56 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac" returned: 0 in 0.660s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:20:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:20:56 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4.07662829-4eb8-493d-99db-1d9f3bce8f79" returned: 0 in 0.820s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-07662829-4eb8-493d-99db-1d9f3bce8f79" released by "_delete_snapshot" :: held 4.377s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:20:56 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Attempting download of 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume eb0f061d-0c5c-49ef-a070-854246adbdac. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 10:20:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-58387d83-3f4b-45af-bb54-5407b2d5fae4" released by "delete_snapshot" :: held 4.420s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:20:56 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[889a903e-6f74-417e-a8f6-f9dae451c903]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_502_4q6p {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:56 devstack cinder-volume[84165]: WARNING cinder.quota [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1847080745 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1847080745, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:20:56 devstack cinder-volume[84165]: WARNING cinder.quota [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1847080745 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1847080745, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:20:56 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] Created reservations ['5486f1d4-b784-4bc9-87c3-5fd74ebabb8a', 'b462cb74-dade-4958-8363-3ea18389c896', '68adb61d-fbc9-4a70-bd06-a1847a455427', '9cf436e7-e9a6-43c6-b146-a9591f7537de'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:20:56 devstack sudo[94615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_502_4q6p
Apr 29 10:20:56 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:56 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8131b89f-f794-47e0-bd15-12807c432090 tempest-GroupSnapshotsTest-1597411933 None] group_snapshot 2204de65-6ffb-46a8-bdce-5927278940d1: deleted successfully
Apr 29 10:20:57 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_502_4q6p" returned: 0 in 0.905s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_502_4q6p {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:57 devstack sudo[94633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_502_4q6p
Apr 29 10:20:57 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "cinder-quobyte-58387d83-3f4b-45af-bb54-5407b2d5fae4" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:20:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-58387d83-3f4b-45af-bb54-5407b2d5fae4" acquired by "delete_volume" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:20:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[99438358-1618-4875-92c2-81bf8640230d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:58 devstack sudo[94638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4
Apr 29 10:20:58 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:58 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_502_4q6p" returned: 1 in 0.772s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_502_4q6p' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:20:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1fc89e-8fd7-422f-af94-c2c6ebd73e34]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:20:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_eg0eo7bsdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:58 devstack sudo[94642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_eg0eo7bsdevstack@QuobyteHD
Apr 29 10:20:58 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:58 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4" returned: 0 in 0.809s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:58 devstack sudo[94650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4
Apr 29 10:20:58 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:59 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_eg0eo7bsdevstack@QuobyteHD" returned: 0 in 0.951s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:59 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] 718e863a-88e0-4753-95be-273177fb3fd1 was qcow2, converting to raw {{(pid=84165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 10:20:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_eg0eo7bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:20:59 devstack sudo[94661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_eg0eo7bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac
Apr 29 10:20:59 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:20:59 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root
Apr 29 10:20:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-58387d83-3f4b-45af-bb54-5407b2d5fae4" returned: 0 in 0.844s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:20:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Lock "cinder-quobyte-58387d83-3f4b-45af-bb54-5407b2d5fae4" released by "delete_volume" :: held 1.735s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:20:59 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Created reservations ['f8de87c5-a5cb-407d-8540-6f8dd1b30f99'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:20:59 devstack cinder-volume[84165]: WARNING cinder.quota [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1847080745 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1847080745, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:20:59 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Created reservations ['1aaa6d16-0118-4b95-856a-8da45131bf9f', '653da5b5-40a8-4d53-b26e-40979cc40ff7', 'b385d95b-4949-484b-a64b-e37343c9cd19', '3776ff34-8282-433b-97ab-89e53f3b7d05'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:21:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:21:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:21:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:21:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:21:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:21:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:21:00 devstack sudo[94665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:21:00 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:21:01 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root
Apr 29 10:21:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.677s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:21:01 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:21:01 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3e3f9ad5-6433-49db-b4c4-7c4ec137d3e2 tempest-GroupSnapshotsTest-1597411933 None] Delete group completed successfully.
Apr 29 10:21:03 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root
Apr 29 10:21:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_eg0eo7bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac" returned: 0 in 3.816s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:21:03 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_eg0eo7bsdevstack@QuobyteHD, size 112.00 MB, duration 3.83 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:21:03 devstack cinder-volume[84165]: INFO cinder.image.image_utils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Converted 112.00 MB image at 29.27 MB/s
Apr 29 10:21:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:21:03 devstack sudo[94806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac 1G
Apr 29 10:21:03 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:21:05 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root
Apr 29 10:21:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac 1G" returned: 0 in 1.791s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:21:05 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7773a53-621a-426b-847e-f2496d4d1e7e]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:21:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:21:05 devstack sudo[94835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac
Apr 29 10:21:05 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:21:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:21:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:21:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:21:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:21:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:21:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:21:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:21:05 devstack sudo[94837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:21:05 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:21:06 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root
Apr 29 10:21:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac" returned: 0 in 1.855s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:21:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:21:07 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root
Apr 29 10:21:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.878s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:21:07 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:21:07 devstack sudo[94843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac
Apr 29 10:21:07 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:21:08 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root
Apr 29 10:21:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac" returned: 1 in 1.535s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:21:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:21:08 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Downloaded image 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume eb0f061d-0c5c-49ef-a070-854246adbdac successfully. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 10:21:08 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 for user 08dc6fb546854355a2658f870a670266 is deleted. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 10:21:08 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Marking volume eb0f061d-0c5c-49ef-a070-854246adbdac as bootable. {{(pid=84165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 10:21:08 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Copying metadata from image 718e863a-88e0-4753-95be-273177fb3fd1 to eb0f061d-0c5c-49ef-a070-854246adbdac. {{(pid=84165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 10:21:08 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Creating volume glance metadata for volume eb0f061d-0c5c-49ef-a070-854246adbdac backed by image 718e863a-88e0-4753-95be-273177fb3fd1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 10:21:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd24e2a-acfc-4d2f-b6e6-aef7f313722d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb0f061d-0c5c-49ef-a070-854246adbdac', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52469a07d0>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:21:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f6d419b-3c0b-428c-9875-afb4c7ca1989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:21:08 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Volume volume-eb0f061d-0c5c-49ef-a070-854246adbdac (eb0f061d-0c5c-49ef-a070-854246adbdac): created successfully
Apr 29 10:21:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f6d419b-3c0b-428c-9875-afb4c7ca1989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:21:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Flow 'volume_create_manager' (94f12f53-e5b3-4be4-98ce-83ade88cf0fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:21:08 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-86b60dd1-ec20-422d-883f-0569e7183a9a tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Created volume successfully.
Apr 29 10:21:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-881534de-8259-43f9-9b8d-ab01d737285b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:21:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-881534de-8259-43f9-9b8d-ab01d737285b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:21:10 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d67a3d-1ad0-4d48-aa6e-48e673d6cef2]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:21:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-881534de-8259-43f9-9b8d-ab01d737285b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:21:11 devstack sudo[94891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac
Apr 29 10:21:11 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:21:13 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root
Apr 29 10:21:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-881534de-8259-43f9-9b8d-ab01d737285b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac" returned: 0 in 2.213s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:21:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-881534de-8259-43f9-9b8d-ab01d737285b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:21:13 devstack sudo[94898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac
Apr 29 10:21:13 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:21:14 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root
Apr 29 10:21:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-881534de-8259-43f9-9b8d-ab01d737285b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac" returned: 1 in 1.282s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:21:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-881534de-8259-43f9-9b8d-ab01d737285b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:21:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-881534de-8259-43f9-9b8d-ab01d737285b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.603s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:21:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-881534de-8259-43f9-9b8d-ab01d737285b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-eb0f061d-0c5c-49ef-a070-854246adbdac', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2902bc03-77fc-4689-a0f3-993692e2477e', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:21:14 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-35a86a03-ecad-4746-8487-e38ac3d028b4 req-881534de-8259-43f9-9b8d-ab01d737285b tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] attachment_update completed successfully.
Apr 29 10:21:24 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=46,cinder:INSERT=16,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:21:24 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=45,cinder:INSERT=16,cinder:UPDATE=47,cinder:DELETE=2 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Flow 'volume_create_manager' (b4adb349-7cd0-49ed-b5dc-b0667175386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f17ba9-7e13-4bdd-8f95-906cce009cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f17ba9-7e13-4bdd-8f95-906cce009cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1132681940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e3b3a5-1678-4660-8c9a-826fcd7d8713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c7d9e78c5744a9f92d988eb8d4a40f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:21:30Z,use_quota=True,user_id='5c21373f087640cdbfc48f9382ad1c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81914e4-1e5e-4baf-97a3-5170c7746d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81914e4-1e5e-4baf-97a3-5170c7746d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11831744-a09c-4a54-b15a-a0a4f925b9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11831744-a09c-4a54-b15a-a0a4f925b9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46e3b3a5-1678-4660-8c9a-826fcd7d8713', 'volume_name': 'volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cff2731-086c-4804-88a3-3ee0bd03c90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cff2731-086c-4804-88a3-3ee0bd03c90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adecac99-ef4d-4837-a869-410ec84e3d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:21:30 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Volume 46e3b3a5-1678-4660-8c9a-826fcd7d8713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713', 'volume_size': 1}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1132681940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e3b3a5-1678-4660-8c9a-826fcd7d8713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c7d9e78c5744a9f92d988eb8d4a40f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:21:30Z,use_quota=True,user_id='5c21373f087640cdbfc48f9382ad1c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Creating volume 46e3b3a5-1678-4660-8c9a-826fcd7d8713 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:21:30 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:21:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:21:30 devstack sudo[95534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713 1073741824
Apr 29 10:21:30 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:21:31 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root
Apr 29 10:21:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713 1073741824" returned: 0 in 1.545s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:21:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:21:32 devstack sudo[95540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713
Apr 29 10:21:32 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:21:33 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root
Apr 29 10:21:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713" returned: 0 in 1.305s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:21:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] <== create_volume: return (2955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:21:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.971s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:21:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adecac99-ef4d-4837-a869-410ec84e3d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:21:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4715359-5667-481b-919d-7bf18209743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:21:33 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Volume volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713 (46e3b3a5-1678-4660-8c9a-826fcd7d8713): created successfully
Apr 29 10:21:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4715359-5667-481b-919d-7bf18209743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:21:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Flow 'volume_create_manager' (b4adb349-7cd0-49ed-b5dc-b0667175386b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:21:33 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-45805ca7-a728-4c61-9b89-92bec4031651 tempest-ServerRescueNegativeTestJSON-1128993470 None] Created volume successfully.
Apr 29 10:21:43 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:21:43 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Flow 'volume_create_manager' (c59c1fe2-3c1a-4509-ba9c-26dae08cd4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8625a04-d333-46d0-aeaf-da8cec6c754f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8625a04-d333-46d0-aeaf-da8cec6c754f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-420214506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488ca91b-d201-4006-aed2-c43e6aa7f7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c7d9e78c5744a9f92d988eb8d4a40f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:21:59Z,use_quota=True,user_id='5c21373f087640cdbfc48f9382ad1c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4739463-7d21-4279-9c47-cb85263963dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4739463-7d21-4279-9c47-cb85263963dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb2873f-db1b-4e5a-8e57-e1bc07aa48d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb2873f-db1b-4e5a-8e57-e1bc07aa48d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488ca91b-d201-4006-aed2-c43e6aa7f7bb', 'volume_name': 'volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ead971-753b-464f-9242-8e789b0166fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ead971-753b-464f-9242-8e789b0166fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f50af01c-6579-4315-830c-c54a58825a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:21:59 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Volume 488ca91b-d201-4006-aed2-c43e6aa7f7bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb', 'volume_size': 1}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-420214506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488ca91b-d201-4006-aed2-c43e6aa7f7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c7d9e78c5744a9f92d988eb8d4a40f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:21:59Z,use_quota=True,user_id='5c21373f087640cdbfc48f9382ad1c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Creating volume 488ca91b-d201-4006-aed2-c43e6aa7f7bb {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:21:59 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:21:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:21:59 devstack sudo[96164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb 1073741824
Apr 29 10:21:59 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:01 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb 1073741824" returned: 0 in 2.403s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:02 devstack sudo[96222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb
Apr 29 10:22:02 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:03 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb" returned: 0 in 1.679s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] <== create_volume: return (4209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:22:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.212s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f50af01c-6579-4315-830c-c54a58825a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a5c9fc5-e000-42b9-b683-5eeb6942fa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:03 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Volume volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb (488ca91b-d201-4006-aed2-c43e6aa7f7bb): created successfully
Apr 29 10:22:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a5c9fc5-e000-42b9-b683-5eeb6942fa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Flow 'volume_create_manager' (c59c1fe2-3c1a-4509-ba9c-26dae08cd4ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:22:03 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3923c3ee-f2ac-4ef0-87e2-187fe7094fa5 tempest-ServerRescueNegativeTestJSON-1128993470 None] Created volume successfully.
Apr 29 10:22:04 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-661de303-30fa-4dbd-9946-a83026b34dca req-1100a350-af1e-4f98-b768-87ae8caf3e88 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Terminate volume connection completed successfully.
Apr 29 10:22:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-661de303-30fa-4dbd-9946-a83026b34dca req-1100a350-af1e-4f98-b768-87ae8caf3e88 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Deleting attachment 2902bc03-77fc-4689-a0f3-993692e2477e. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:22:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Acquiring lock "cinder-eb0f061d-0c5c-49ef-a070-854246adbdac-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:22:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:22:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:22:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:22:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:22:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:22:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "cinder-eb0f061d-0c5c-49ef-a070-854246adbdac-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:22:05 devstack sudo[96229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:22:05 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Acquiring lock "cinder-quobyte-eb0f061d-0c5c-49ef-a070-854246adbdac" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:22:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "cinder-quobyte-eb0f061d-0c5c-49ef-a070-854246adbdac" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:22:05 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[feae6a9b-5e11-4924-89be-0d5c35924212]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:22:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:06 devstack sudo[96231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac
Apr 29 10:22:06 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:06 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.434s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:22:08 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac" returned: 0 in 2.305s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:08 devstack sudo[96237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac
Apr 29 10:22:08 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:09 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac" returned: 1 in 1.615s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:22:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:09 devstack sudo[96244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac
Apr 29 10:22:09 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:11 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-eb0f061d-0c5c-49ef-a070-854246adbdac" returned: 0 in 1.428s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "cinder-quobyte-eb0f061d-0c5c-49ef-a070-854246adbdac" released by "delete_volume" :: held 5.487s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:22:11 devstack cinder-volume[84165]: DEBUG cinder.quota [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Created reservations ['8f38c5b4-1e42-4146-b1c4-ec38480164a5', '096d318e-1283-4e2f-83a3-b5a14d572158', '205fcaa7-1c64-49b4-87a4-a21e8133b116', '2c3c2a97-082f-487a-9762-5e75e6bc290b'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:22:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:22:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:22:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:22:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:22:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:11 devstack sudo[96254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:22:11 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:12 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.330s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:12 devstack cinder-volume[84165]: DEBUG cinder.manager [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:22:12 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Deleted volume successfully.
Apr 29 10:22:12 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-661de303-30fa-4dbd-9946-a83026b34dca req-afb4d827-bd74-4299-bc29-38fdd41825f9 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "cinder-eb0f061d-0c5c-49ef-a070-854246adbdac-delete_volume" released by "delete_volume" :: held 7.191s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:22:21 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:22:22 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=12,cinder:SELECT=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Flow 'volume_create_manager' (a39f6d55-a2db-45ff-b2c9-4def57b40400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43dff217-3268-453c-b4d8-d629d61d855e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43dff217-3268-453c-b4d8-d629d61d855e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1586124211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f2aaca8-ba2e-43fc-ae32-efd4563308a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b68ec8429437085fa78534eccc292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:22:24Z,use_quota=True,user_id='cfc733c400ef45e4a966257ba7b115e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a826a8-3347-4d73-a63f-2e64511e860b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a826a8-3347-4d73-a63f-2e64511e860b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4581fd8-68d7-4c22-b15f-e68e61a63d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4581fd8-68d7-4c22-b15f-e68e61a63d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f2aaca8-ba2e-43fc-ae32-efd4563308a7', 'volume_name': 'volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f1e21f-eed2-4391-9ee7-bbd089408259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f1e21f-eed2-4391-9ee7-bbd089408259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (702d94f4-7d16-44b9-9b2e-bd867f6a0889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:23 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Volume 5f2aaca8-ba2e-43fc-ae32-efd4563308a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7', 'volume_size': 1}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1586124211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f2aaca8-ba2e-43fc-ae32-efd4563308a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b68ec8429437085fa78534eccc292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:22:24Z,use_quota=True,user_id='cfc733c400ef45e4a966257ba7b115e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Creating volume 5f2aaca8-ba2e-43fc-ae32-efd4563308a7 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:22:23 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:22:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:23 devstack sudo[96475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7 1073741824
Apr 29 10:22:23 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:24 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-200b0ef5-eea3-42de-b1f7-a514b023d6b7 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Terminate volume connection completed successfully.
Apr 29 10:22:24 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-200b0ef5-eea3-42de-b1f7-a514b023d6b7 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Deleting attachment 512ceb02-c308-421d-bee5-55cbad8e62af. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:22:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Acquiring lock "cinder-001aaec9-89f0-42b3-a83f-726b3b331b02-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:22:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "cinder-001aaec9-89f0-42b3-a83f-726b3b331b02-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:22:25 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7 1073741824" returned: 0 in 1.240s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Acquiring lock "cinder-quobyte-001aaec9-89f0-42b3-a83f-726b3b331b02" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:22:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "cinder-quobyte-001aaec9-89f0-42b3-a83f-726b3b331b02" acquired by "delete_volume" :: waited 0.036s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:22:25 devstack sudo[96494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7
Apr 29 10:22:25 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:25 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a1f31e-490f-49f0-9841-89f0e7cafdcd]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:22:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-001aaec9-89f0-42b3-a83f-726b3b331b02 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:25 devstack sudo[96496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-001aaec9-89f0-42b3-a83f-726b3b331b02
Apr 29 10:22:25 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:26 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7" returned: 0 in 0.957s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:26 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] <== create_volume: return (2297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:22:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.303s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (702d94f4-7d16-44b9-9b2e-bd867f6a0889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090d55c5-3957-4392-bee5-873a8b752342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:26 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Volume volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7 (5f2aaca8-ba2e-43fc-ae32-efd4563308a7): created successfully
Apr 29 10:22:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090d55c5-3957-4392-bee5-873a8b752342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Flow 'volume_create_manager' (a39f6d55-a2db-45ff-b2c9-4def57b40400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:22:26 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1a512a09-72c1-4ce4-8fdb-16295b5ae2f1 tempest-AttachVolumeShelveTestJSON-921790343 None] Created volume successfully.
Apr 29 10:22:26 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-001aaec9-89f0-42b3-a83f-726b3b331b02" returned: 0 in 1.042s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-001aaec9-89f0-42b3-a83f-726b3b331b02 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:26 devstack sudo[96503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-001aaec9-89f0-42b3-a83f-726b3b331b02
Apr 29 10:22:26 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:27 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-001aaec9-89f0-42b3-a83f-726b3b331b02" returned: 0 in 1.004s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "cinder-quobyte-001aaec9-89f0-42b3-a83f-726b3b331b02" released by "delete_volume" :: held 2.157s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:22:27 devstack cinder-volume[84165]: DEBUG cinder.quota [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Created reservations ['3a432e35-43f3-4aa9-9f07-ee6aa9223a74', '13c3f701-5dc8-41bd-ab32-bd69248fe9a6', '89412048-e10b-4e95-94bd-d486484063f5', 'af8b3529-26d2-4e5e-bb81-df6f3e2fb7b7'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:22:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:22:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:22:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:22:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:22:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:27 devstack sudo[96546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:22:27 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:28 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.170s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:28 devstack cinder-volume[84165]: DEBUG cinder.manager [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:22:28 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Deleted volume successfully.
Apr 29 10:22:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-5eb65fe3-6595-4ab8-97f0-701df7be0ab7 req-f50bf49b-810d-4fe2-b658-6fd2926ca8c0 tempest-ServerBootFromVolumeStableRescueTest-2142209564 None] Lock "cinder-001aaec9-89f0-42b3-a83f-726b3b331b02-delete_volume" released by "delete_volume" :: held 3.737s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:22:37 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:22:38 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=11,cinder:SELECT=9,cinder:INSERT=3,cinder:DELETE=2 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:22:43 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:22:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Flow 'volume_create_manager' (0507335b-dd73-4e28-b61d-860ff4faa242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:22:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfca2a55-5038-4c79-8922-f13dd1218949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfca2a55-5038-4c79-8922-f13dd1218949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-769895753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7345331-0d30-4b5d-933a-1944fb89dae6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17f2dc9488c046018525e27e735c21a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:22:44Z,use_quota=True,user_id='196b22f4a8694085be2a0e82a6736a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6ca88d-65f9-44f8-b4a8-2ba606f3a0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6ca88d-65f9-44f8-b4a8-2ba606f3a0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cef02ca-2bee-4f8d-9e9f-836a66984694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cef02ca-2bee-4f8d-9e9f-836a66984694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7345331-0d30-4b5d-933a-1944fb89dae6', 'volume_name': 'volume-a7345331-0d30-4b5d-933a-1944fb89dae6', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae454f1-2af6-46d9-af15-43c68d99590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae454f1-2af6-46d9-af15-43c68d99590a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a28af9c-9b08-4532-8741-0a9b1992320f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:44 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Volume a7345331-0d30-4b5d-933a-1944fb89dae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7345331-0d30-4b5d-933a-1944fb89dae6', 'volume_size': 1}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-769895753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7345331-0d30-4b5d-933a-1944fb89dae6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17f2dc9488c046018525e27e735c21a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:22:44Z,use_quota=True,user_id='196b22f4a8694085be2a0e82a6736a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Creating volume a7345331-0d30-4b5d-933a-1944fb89dae6 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:22:44 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:22:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a7345331-0d30-4b5d-933a-1944fb89dae6 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:44 devstack sudo[96629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a7345331-0d30-4b5d-933a-1944fb89dae6 1073741824
Apr 29 10:22:44 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:45 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a7345331-0d30-4b5d-933a-1944fb89dae6 1073741824" returned: 0 in 1.038s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a7345331-0d30-4b5d-933a-1944fb89dae6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:45 devstack sudo[96635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a7345331-0d30-4b5d-933a-1944fb89dae6
Apr 29 10:22:45 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:45 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a7345331-0d30-4b5d-933a-1944fb89dae6" returned: 0 in 0.640s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:22:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a28af9c-9b08-4532-8741-0a9b1992320f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7345331-0d30-4b5d-933a-1944fb89dae6', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10e89a2-2929-4028-94c9-b037b4579eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:45 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Volume volume-a7345331-0d30-4b5d-933a-1944fb89dae6 (a7345331-0d30-4b5d-933a-1944fb89dae6): created successfully
Apr 29 10:22:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10e89a2-2929-4028-94c9-b037b4579eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Flow 'volume_create_manager' (0507335b-dd73-4e28-b61d-860ff4faa242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:22:45 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-7524506d-bc7c-484d-b850-1ef900b2b4d0 tempest-VolumesTestJSON-930516837 None] Created volume successfully.
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Flow 'volume_create_manager' (a70ef8a6-eb07-4005-8bf4-109ef892daf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69ee511-30c6-4926-9940-9cb303c74db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69ee511-30c6-4926-9940-9cb303c74db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-608588915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de63b7e-6668-4344-81ba-0567bd11e9e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17f2dc9488c046018525e27e735c21a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:22:47Z,use_quota=True,user_id='196b22f4a8694085be2a0e82a6736a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deff50cc-563d-4633-9529-f9e70197033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deff50cc-563d-4633-9529-f9e70197033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73e4970-16f6-47e7-ba6e-254adf15c806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73e4970-16f6-47e7-ba6e-254adf15c806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3de63b7e-6668-4344-81ba-0567bd11e9e7', 'volume_name': 'volume-3de63b7e-6668-4344-81ba-0567bd11e9e7', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0922f594-346c-41e7-b7d4-430ccff7d182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0922f594-346c-41e7-b7d4-430ccff7d182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a71085-5da2-4c4f-aac3-7f9379fbc496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:46 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Volume 3de63b7e-6668-4344-81ba-0567bd11e9e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3de63b7e-6668-4344-81ba-0567bd11e9e7', 'volume_size': 1}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-608588915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de63b7e-6668-4344-81ba-0567bd11e9e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17f2dc9488c046018525e27e735c21a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:22:47Z,use_quota=True,user_id='196b22f4a8694085be2a0e82a6736a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Creating volume 3de63b7e-6668-4344-81ba-0567bd11e9e7 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:22:46 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:22:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3de63b7e-6668-4344-81ba-0567bd11e9e7 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:46 devstack sudo[96641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3de63b7e-6668-4344-81ba-0567bd11e9e7 1073741824
Apr 29 10:22:46 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:47 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3de63b7e-6668-4344-81ba-0567bd11e9e7 1073741824" returned: 0 in 1.021s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3de63b7e-6668-4344-81ba-0567bd11e9e7 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:47 devstack sudo[96647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3de63b7e-6668-4344-81ba-0567bd11e9e7
Apr 29 10:22:47 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:48 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3de63b7e-6668-4344-81ba-0567bd11e9e7" returned: 0 in 0.698s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:22:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a71085-5da2-4c4f-aac3-7f9379fbc496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3de63b7e-6668-4344-81ba-0567bd11e9e7', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7feed0-aa11-4ca1-9f80-e25d8bb62255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:48 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Volume volume-3de63b7e-6668-4344-81ba-0567bd11e9e7 (3de63b7e-6668-4344-81ba-0567bd11e9e7): created successfully
Apr 29 10:22:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7feed0-aa11-4ca1-9f80-e25d8bb62255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Flow 'volume_create_manager' (a70ef8a6-eb07-4005-8bf4-109ef892daf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:22:48 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-f7545e20-5296-44c3-b9f8-4815721125f3 tempest-VolumesTestJSON-930516837 None] Created volume successfully.
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Flow 'volume_create_manager' (b9236d48-3fe0-4bba-bbca-07a372b8ad48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdcd2849-c5e4-475f-9a45-683a4856e4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdcd2849-c5e4-475f-9a45-683a4856e4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1691179914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b668c3-03f4-43d5-8101-b1977c860459,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17f2dc9488c046018525e27e735c21a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:22:49Z,use_quota=True,user_id='196b22f4a8694085be2a0e82a6736a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd1b8f0-a2a8-4aac-b67e-a713ef5e9539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd1b8f0-a2a8-4aac-b67e-a713ef5e9539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94a2194-7bb3-47db-8e52-d23d546447d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94a2194-7bb3-47db-8e52-d23d546447d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b668c3-03f4-43d5-8101-b1977c860459', 'volume_name': 'volume-25b668c3-03f4-43d5-8101-b1977c860459', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c03fced-2789-49dd-a98c-fb85c138c912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c03fced-2789-49dd-a98c-fb85c138c912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0ea454-6a85-4bad-b025-e3e066920537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:49 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Volume 25b668c3-03f4-43d5-8101-b1977c860459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b668c3-03f4-43d5-8101-b1977c860459', 'volume_size': 1}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1691179914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b668c3-03f4-43d5-8101-b1977c860459,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17f2dc9488c046018525e27e735c21a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:22:49Z,use_quota=True,user_id='196b22f4a8694085be2a0e82a6736a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Creating volume 25b668c3-03f4-43d5-8101-b1977c860459 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:22:49 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:22:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-25b668c3-03f4-43d5-8101-b1977c860459 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:49 devstack sudo[96652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-25b668c3-03f4-43d5-8101-b1977c860459 1073741824
Apr 29 10:22:49 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:50 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-25b668c3-03f4-43d5-8101-b1977c860459 1073741824" returned: 0 in 0.959s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-25b668c3-03f4-43d5-8101-b1977c860459 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:50 devstack sudo[96660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-25b668c3-03f4-43d5-8101-b1977c860459
Apr 29 10:22:50 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:51 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-25b668c3-03f4-43d5-8101-b1977c860459" returned: 0 in 0.627s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:22:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0ea454-6a85-4bad-b025-e3e066920537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b668c3-03f4-43d5-8101-b1977c860459', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7c7017-96ed-428a-9c74-cc21718ac2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:22:51 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Volume volume-25b668c3-03f4-43d5-8101-b1977c860459 (25b668c3-03f4-43d5-8101-b1977c860459): created successfully
Apr 29 10:22:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7c7017-96ed-428a-9c74-cc21718ac2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:22:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Flow 'volume_create_manager' (b9236d48-3fe0-4bba-bbca-07a372b8ad48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:22:51 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-4093dc24-b26a-4f3e-abc3-11308727027a tempest-VolumesTestJSON-930516837 None] Created volume successfully.
Apr 29 10:22:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-ba61d3fe-42f1-4905-a761-aec1336ac097 req-8fda4d14-d7cd-47c0-987f-2f1959838ead tempest-AttachVolumeShelveTestJSON-921790343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:22:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-ba61d3fe-42f1-4905-a761-aec1336ac097 req-8fda4d14-d7cd-47c0-987f-2f1959838ead tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:22:51 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf57c730-ddbf-4b8b-a24b-776197f8604f]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:22:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-ba61d3fe-42f1-4905-a761-aec1336ac097 req-8fda4d14-d7cd-47c0-987f-2f1959838ead tempest-AttachVolumeShelveTestJSON-921790343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:51 devstack sudo[96671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7
Apr 29 10:22:51 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Acquiring lock "cinder-25b668c3-03f4-43d5-8101-b1977c860459-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:22:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Lock "cinder-25b668c3-03f4-43d5-8101-b1977c860459-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:22:52 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-ba61d3fe-42f1-4905-a761-aec1336ac097 req-8fda4d14-d7cd-47c0-987f-2f1959838ead tempest-AttachVolumeShelveTestJSON-921790343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7" returned: 0 in 0.851s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-ba61d3fe-42f1-4905-a761-aec1336ac097 req-8fda4d14-d7cd-47c0-987f-2f1959838ead tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.872s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Acquiring lock "cinder-quobyte-25b668c3-03f4-43d5-8101-b1977c860459" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:22:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-ba61d3fe-42f1-4905-a761-aec1336ac097 req-8fda4d14-d7cd-47c0-987f-2f1959838ead tempest-AttachVolumeShelveTestJSON-921790343 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '001610cf-d010-4cd0-8bf3-f87340a2dca4', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:22:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Lock "cinder-quobyte-25b668c3-03f4-43d5-8101-b1977c860459" acquired by "delete_volume" :: waited 0.030s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:22:52 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e0b82f-1cf4-4531-9621-96fbf9e94ef0]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:22:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-25b668c3-03f4-43d5-8101-b1977c860459 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:52 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-ba61d3fe-42f1-4905-a761-aec1336ac097 req-8fda4d14-d7cd-47c0-987f-2f1959838ead tempest-AttachVolumeShelveTestJSON-921790343 None] attachment_update completed successfully.
Apr 29 10:22:52 devstack sudo[96676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-25b668c3-03f4-43d5-8101-b1977c860459
Apr 29 10:22:52 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:53 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-25b668c3-03f4-43d5-8101-b1977c860459" returned: 0 in 0.750s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-25b668c3-03f4-43d5-8101-b1977c860459 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:53 devstack sudo[96682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-25b668c3-03f4-43d5-8101-b1977c860459
Apr 29 10:22:53 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:53 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-25b668c3-03f4-43d5-8101-b1977c860459" returned: 0 in 0.649s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Lock "cinder-quobyte-25b668c3-03f4-43d5-8101-b1977c860459" released by "delete_volume" :: held 1.445s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:22:53 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Created reservations ['afd80b2c-b1d9-4767-835c-fd4a90aa21bf', '00903071-48ae-4dfa-ae60-76941824bec3', '200f77fe-93c7-43e1-9ad2-5d3f36621166', 'b2a3a625-2318-4678-a5e9-779902832491'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:22:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:22:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:22:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:22:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:22:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:54 devstack sudo[96685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:22:54 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Acquiring lock "cinder-3de63b7e-6668-4344-81ba-0567bd11e9e7-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:22:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Lock "cinder-3de63b7e-6668-4344-81ba-0567bd11e9e7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:22:54 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.639s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:54 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:22:54 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Deleted volume successfully.
Apr 29 10:22:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Acquiring lock "cinder-quobyte-3de63b7e-6668-4344-81ba-0567bd11e9e7" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:22:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Lock "cinder-quobyte-3de63b7e-6668-4344-81ba-0567bd11e9e7" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:22:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5df7efaa-6101-4121-ac94-4d56bf51f02f tempest-VolumesTestJSON-930516837 None] Lock "cinder-25b668c3-03f4-43d5-8101-b1977c860459-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:22:54 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0257c07c-62e9-40f8-b511-fbab2da7f025]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:22:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3de63b7e-6668-4344-81ba-0567bd11e9e7 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:54 devstack sudo[96688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3de63b7e-6668-4344-81ba-0567bd11e9e7
Apr 29 10:22:54 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:55 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3de63b7e-6668-4344-81ba-0567bd11e9e7" returned: 0 in 0.802s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3de63b7e-6668-4344-81ba-0567bd11e9e7 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:55 devstack sudo[96694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3de63b7e-6668-4344-81ba-0567bd11e9e7
Apr 29 10:22:55 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:56 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3de63b7e-6668-4344-81ba-0567bd11e9e7" returned: 0 in 0.698s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Lock "cinder-quobyte-3de63b7e-6668-4344-81ba-0567bd11e9e7" released by "delete_volume" :: held 1.560s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:22:56 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Created reservations ['c092e7f6-f5f3-4094-b784-abf18060fcb5', 'a7fecdce-5171-4388-8867-e3675033457d', '2d4821cd-b434-424c-8653-863997aa9093', '5c4418e9-604d-4fb1-8568-070e4628c678'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:22:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:22:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:22:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:22:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:22:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:56 devstack sudo[96697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:22:56 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Acquiring lock "cinder-a7345331-0d30-4b5d-933a-1944fb89dae6-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:22:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Lock "cinder-a7345331-0d30-4b5d-933a-1944fb89dae6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:22:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Acquiring lock "cinder-quobyte-a7345331-0d30-4b5d-933a-1944fb89dae6" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:22:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Lock "cinder-quobyte-a7345331-0d30-4b5d-933a-1944fb89dae6" acquired by "delete_volume" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:22:57 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[22100ccc-85f3-4fc9-9cf5-983fbf137d87]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:22:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a7345331-0d30-4b5d-933a-1944fb89dae6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:57 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.753s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:57 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:22:57 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Deleted volume successfully.
Apr 29 10:22:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-59fae3b7-084b-4e6d-9789-219b904fe5ad tempest-VolumesTestJSON-930516837 None] Lock "cinder-3de63b7e-6668-4344-81ba-0567bd11e9e7-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:22:57 devstack sudo[96714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a7345331-0d30-4b5d-933a-1944fb89dae6
Apr 29 10:22:57 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:57 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a7345331-0d30-4b5d-933a-1944fb89dae6" returned: 0 in 0.732s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a7345331-0d30-4b5d-933a-1944fb89dae6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:57 devstack sudo[96721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a7345331-0d30-4b5d-933a-1944fb89dae6
Apr 29 10:22:57 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:58 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a7345331-0d30-4b5d-933a-1944fb89dae6" returned: 0 in 0.737s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Lock "cinder-quobyte-a7345331-0d30-4b5d-933a-1944fb89dae6" released by "delete_volume" :: held 1.544s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:22:58 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Created reservations ['237560b5-a746-41ae-9d7f-580bb2987888', '2a47c9de-fd96-442c-b011-1e3358019be5', 'e90b8cad-e6d8-4d26-9674-d60a1cc076e3', '0d75171c-60d0-4d7d-8fac-f0791e9d0d6e'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:22:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:22:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:22:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:22:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:22:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:22:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:22:58 devstack sudo[96727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:22:58 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:22:59 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root
Apr 29 10:22:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.637s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:22:59 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:22:59 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Deleted volume successfully.
Apr 29 10:22:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-38af3ee7-f133-410d-ad59-df7639501dfd tempest-VolumesTestJSON-930516837 None] Lock "cinder-a7345331-0d30-4b5d-933a-1944fb89dae6-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-bef364d7-d6d0-439f-8bea-9236ec7e3cc5 req-276969cf-1553-422f-9dde-d912f17be8c6 tempest-ServerRescueNegativeTestJSON-1128993470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-bef364d7-d6d0-439f-8bea-9236ec7e3cc5 req-276969cf-1553-422f-9dde-d912f17be8c6 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:02 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae63774-1668-461f-8f1c-109644d2d77c]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-bef364d7-d6d0-439f-8bea-9236ec7e3cc5 req-276969cf-1553-422f-9dde-d912f17be8c6 tempest-ServerRescueNegativeTestJSON-1128993470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:03 devstack sudo[96793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb
Apr 29 10:23:03 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:04 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-bef364d7-d6d0-439f-8bea-9236ec7e3cc5 req-276969cf-1553-422f-9dde-d912f17be8c6 tempest-ServerRescueNegativeTestJSON-1128993470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb" returned: 0 in 1.380s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-bef364d7-d6d0-439f-8bea-9236ec7e3cc5 req-276969cf-1553-422f-9dde-d912f17be8c6 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.437s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-bef364d7-d6d0-439f-8bea-9236ec7e3cc5 req-276969cf-1553-422f-9dde-d912f17be8c6 tempest-ServerRescueNegativeTestJSON-1128993470 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6aa35eb-145e-470e-b429-59d395823b9d', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:23:04 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-bef364d7-d6d0-439f-8bea-9236ec7e3cc5 req-276969cf-1553-422f-9dde-d912f17be8c6 tempest-ServerRescueNegativeTestJSON-1128993470 None] attachment_update completed successfully.
Apr 29 10:23:04 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-26ff97ea-6023-4093-b936-42534100da63 tempest-GroupsV320Test-2037488131 None] Group tempest-GroupsV320Test-Group-1482159921: creating
Apr 29 10:23:04 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-26ff97ea-6023-4093-b936-42534100da63 tempest-GroupsV320Test-2037488131 None] Group tempest-GroupsV320Test-Group-1482159921: created successfully
Apr 29 10:23:04 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-26ff97ea-6023-4093-b936-42534100da63 tempest-GroupsV320Test-2037488131 None] Create group completed successfully.
Apr 29 10:23:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:23:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:23:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:23:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:05 devstack sudo[96911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:23:05 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:06 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.143s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:23:06 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:23:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Flow 'volume_create_manager' (919bab0c-b50a-41eb-a58b-6a7e80d69182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:23:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed717a3b-a6fb-4eb9-87ca-9a25fc293f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed717a3b-a6fb-4eb9-87ca-9a25fc293f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-969467898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3bc430-18ee-4951-84c5-d2497fc74e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='272edd301cc046b681de4c95d2aadb7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:23:07Z,use_quota=True,user_id='6b6888005e7c4238aa227668ec102144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f4d2b6-a718-48fa-82ef-ff4ad0cc9748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f4d2b6-a718-48fa-82ef-ff4ad0cc9748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4e1d5c-92df-412d-86e8-2737b50e2f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4e1d5c-92df-412d-86e8-2737b50e2f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3bc430-18ee-4951-84c5-d2497fc74e64', 'volume_name': 'volume-9c3bc430-18ee-4951-84c5-d2497fc74e64', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d9227a-3e0d-4b5d-8b85-4463711f8ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d9227a-3e0d-4b5d-8b85-4463711f8ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86c4f03-4a5e-489e-9893-1842dbfacac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:07 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Volume 9c3bc430-18ee-4951-84c5-d2497fc74e64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3bc430-18ee-4951-84c5-d2497fc74e64', 'volume_size': 1}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-969467898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3bc430-18ee-4951-84c5-d2497fc74e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='272edd301cc046b681de4c95d2aadb7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:23:07Z,use_quota=True,user_id='6b6888005e7c4238aa227668ec102144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Creating volume 9c3bc430-18ee-4951-84c5-d2497fc74e64 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:23:07 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c3bc430-18ee-4951-84c5-d2497fc74e64 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-47af59e6-81ad-45a7-8b9f-01f8db18788b tempest-GroupsV320Test-2037488131 None] Created reservations ['ca2f56fd-c413-42ce-a7a1-77fdb2bfe4f9'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:23:07 devstack sudo[97229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c3bc430-18ee-4951-84c5-d2497fc74e64 1073741824
Apr 29 10:23:07 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-47af59e6-81ad-45a7-8b9f-01f8db18788b tempest-GroupsV320Test-2037488131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-47af59e6-81ad-45a7-8b9f-01f8db18788b tempest-GroupsV320Test-2037488131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-47af59e6-81ad-45a7-8b9f-01f8db18788b tempest-GroupsV320Test-2037488131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-47af59e6-81ad-45a7-8b9f-01f8db18788b tempest-GroupsV320Test-2037488131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-47af59e6-81ad-45a7-8b9f-01f8db18788b tempest-GroupsV320Test-2037488131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-47af59e6-81ad-45a7-8b9f-01f8db18788b tempest-GroupsV320Test-2037488131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:07 devstack sudo[97231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:23:07 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:07 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-47af59e6-81ad-45a7-8b9f-01f8db18788b tempest-GroupsV320Test-2037488131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.737s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:07 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-47af59e6-81ad-45a7-8b9f-01f8db18788b tempest-GroupsV320Test-2037488131 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:23:07 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-47af59e6-81ad-45a7-8b9f-01f8db18788b tempest-GroupsV320Test-2037488131 None] Delete group completed successfully.
Apr 29 10:23:08 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c3bc430-18ee-4951-84c5-d2497fc74e64 1073741824" returned: 0 in 0.971s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c3bc430-18ee-4951-84c5-d2497fc74e64 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:08 devstack sudo[97238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c3bc430-18ee-4951-84c5-d2497fc74e64
Apr 29 10:23:08 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:08 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c3bc430-18ee-4951-84c5-d2497fc74e64" returned: 0 in 0.733s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:23:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86c4f03-4a5e-489e-9893-1842dbfacac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3bc430-18ee-4951-84c5-d2497fc74e64', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb22245a-c143-4485-a55f-afe400d95ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:08 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Volume volume-9c3bc430-18ee-4951-84c5-d2497fc74e64 (9c3bc430-18ee-4951-84c5-d2497fc74e64): created successfully
Apr 29 10:23:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb22245a-c143-4485-a55f-afe400d95ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Flow 'volume_create_manager' (919bab0c-b50a-41eb-a58b-6a7e80d69182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:23:08 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-6277fe34-732a-4e08-9845-c5376c1710a9 tempest-VolumesActionsTest-924915035 None] Created volume successfully.
Apr 29 10:23:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-852ac69d-0e7e-44d9-a6c0-d924de4a6af8 tempest-VolumesActionsTest-924915035 None] Acquiring lock "cinder-9c3bc430-18ee-4951-84c5-d2497fc74e64" by "attach_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-852ac69d-0e7e-44d9-a6c0-d924de4a6af8 tempest-VolumesActionsTest-924915035 None] Lock "cinder-9c3bc430-18ee-4951-84c5-d2497fc74e64" acquired by "attach_volume" :: waited 0.050s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:09 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-852ac69d-0e7e-44d9-a6c0-d924de4a6af8 tempest-VolumesActionsTest-924915035 None] Attaching volume 9c3bc430-18ee-4951-84c5-d2497fc74e64 to instance 59c39fd2-a492-47a0-8b56-4ba75e28547a at mountpoint /dev/vdb on host None.
Apr 29 10:23:09 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-852ac69d-0e7e-44d9-a6c0-d924de4a6af8 tempest-VolumesActionsTest-924915035 None] Attach volume completed successfully.
Apr 29 10:23:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-852ac69d-0e7e-44d9-a6c0-d924de4a6af8 tempest-VolumesActionsTest-924915035 None] Lock "cinder-9c3bc430-18ee-4951-84c5-d2497fc74e64" released by "attach_volume" :: held 0.142s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:10 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0873df99-3f2a-41eb-8033-8e0dea551ce2 tempest-VolumesActionsTest-803628272 None] Terminate volume connection completed successfully.
Apr 29 10:23:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0873df99-3f2a-41eb-8033-8e0dea551ce2 tempest-VolumesActionsTest-803628272 None] Acquiring lock "cinder-9c3bc430-18ee-4951-84c5-d2497fc74e64-detach_volume" by "detach_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0873df99-3f2a-41eb-8033-8e0dea551ce2 tempest-VolumesActionsTest-803628272 None] Lock "cinder-9c3bc430-18ee-4951-84c5-d2497fc74e64-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:11 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0873df99-3f2a-41eb-8033-8e0dea551ce2 tempest-VolumesActionsTest-803628272 None] Detaching volume 9c3bc430-18ee-4951-84c5-d2497fc74e64 from instance 59c39fd2-a492-47a0-8b56-4ba75e28547a.
Apr 29 10:23:11 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0873df99-3f2a-41eb-8033-8e0dea551ce2 tempest-VolumesActionsTest-803628272 None] Detach volume completed successfully.
Apr 29 10:23:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0873df99-3f2a-41eb-8033-8e0dea551ce2 tempest-VolumesActionsTest-803628272 None] Lock "cinder-9c3bc430-18ee-4951-84c5-d2497fc74e64-detach_volume" released by "detach_volume" :: held 0.149s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:12 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-80513506-6117-487a-a8b2-6ffc5d87097d tempest-VolumesActionsTest-924915035 None] Acquiring lock "cinder-9c3bc430-18ee-4951-84c5-d2497fc74e64-detach_volume" by "detach_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:12 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-80513506-6117-487a-a8b2-6ffc5d87097d tempest-VolumesActionsTest-924915035 None] Lock "cinder-9c3bc430-18ee-4951-84c5-d2497fc74e64-detach_volume" acquired by "detach_volume" :: waited 0.067s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:12 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-80513506-6117-487a-a8b2-6ffc5d87097d tempest-VolumesActionsTest-924915035 None] Volume detach called, but volume not attached.
Apr 29 10:23:12 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-80513506-6117-487a-a8b2-6ffc5d87097d tempest-VolumesActionsTest-924915035 None] Lock "cinder-9c3bc430-18ee-4951-84c5-d2497fc74e64-detach_volume" released by "detach_volume" :: held 0.052s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:12 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Acquiring lock "cinder-9c3bc430-18ee-4951-84c5-d2497fc74e64-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:12 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Lock "cinder-9c3bc430-18ee-4951-84c5-d2497fc74e64-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:13 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Acquiring lock "cinder-quobyte-9c3bc430-18ee-4951-84c5-d2497fc74e64" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:13 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Lock "cinder-quobyte-9c3bc430-18ee-4951-84c5-d2497fc74e64" acquired by "delete_volume" :: waited 0.043s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:13 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceb7bdd-eef9-451c-95dc-7f6577ddac94]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c3bc430-18ee-4951-84c5-d2497fc74e64 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:13 devstack sudo[97322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c3bc430-18ee-4951-84c5-d2497fc74e64
Apr 29 10:23:13 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:15 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c3bc430-18ee-4951-84c5-d2497fc74e64" returned: 0 in 2.028s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c3bc430-18ee-4951-84c5-d2497fc74e64 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:15 devstack sudo[97396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c3bc430-18ee-4951-84c5-d2497fc74e64
Apr 29 10:23:15 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:16 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c3bc430-18ee-4951-84c5-d2497fc74e64" returned: 0 in 1.034s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:16 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Lock "cinder-quobyte-9c3bc430-18ee-4951-84c5-d2497fc74e64" released by "delete_volume" :: held 3.170s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:16 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Created reservations ['4f900540-f649-470b-aa6c-528526e3b886', '72ba767c-a18f-4c6f-904e-0610ac06db2f', 'f9b7f3ec-8eaf-4d16-989c-0fe01a87cf05', '0d38b6be-b2dc-4a6f-8751-f39c259a5bed'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:23:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:23:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:23:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:16 devstack sudo[97407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:23:16 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:17 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.379s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:17 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:23:17 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Deleted volume successfully.
Apr 29 10:23:17 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dc91abac-6de2-41b1-9131-b3efa1cb2992 tempest-VolumesActionsTest-924915035 None] Lock "cinder-9c3bc430-18ee-4951-84c5-d2497fc74e64-delete_volume" released by "delete_volume" :: held 4.999s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Flow 'volume_create_manager' (d78e8915-7276-4ba2-84d6-55e5897aea88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3baee9-bafb-4d19-81a7-96a5d7220689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3baee9-bafb-4d19-81a7-96a5d7220689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1636447733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cda0f85-4f37-4e62-995a-dec2392f168b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e2b54307264feb87ee06da65a6a182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:23:19Z,use_quota=True,user_id='2e63644a3092435eb8e3ca1d55998a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5963a51-d50f-46b7-a2f6-53e53314a557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5963a51-d50f-46b7-a2f6-53e53314a557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784b7b99-3810-4946-b974-00af9d7f1896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784b7b99-3810-4946-b974-00af9d7f1896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cda0f85-4f37-4e62-995a-dec2392f168b', 'volume_name': 'volume-9cda0f85-4f37-4e62-995a-dec2392f168b', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6c74f2-36ed-40d1-889c-01cdbd391776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6c74f2-36ed-40d1-889c-01cdbd391776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a140ec-d64e-4c4f-96cf-ac6846eb4ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:19 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Volume 9cda0f85-4f37-4e62-995a-dec2392f168b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cda0f85-4f37-4e62-995a-dec2392f168b', 'volume_size': 1}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1636447733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cda0f85-4f37-4e62-995a-dec2392f168b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e2b54307264feb87ee06da65a6a182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:23:19Z,use_quota=True,user_id='2e63644a3092435eb8e3ca1d55998a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Creating volume 9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:23:19 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:23:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:19 devstack sudo[97509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b 1073741824
Apr 29 10:23:19 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:20 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b 1073741824" returned: 0 in 1.392s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:20 devstack sudo[97574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b
Apr 29 10:23:20 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:21 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b" returned: 0 in 1.170s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] <== create_volume: return (2637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:23:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.641s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a140ec-d64e-4c4f-96cf-ac6846eb4ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cda0f85-4f37-4e62-995a-dec2392f168b', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac570e17-702b-4a2b-801f-7bd81107aaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:22 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Volume volume-9cda0f85-4f37-4e62-995a-dec2392f168b (9cda0f85-4f37-4e62-995a-dec2392f168b): created successfully
Apr 29 10:23:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac570e17-702b-4a2b-801f-7bd81107aaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Flow 'volume_create_manager' (d78e8915-7276-4ba2-84d6-55e5897aea88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:23:22 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3da19769-5dcc-4fa6-91cb-65346f64a8be tempest-SnapshotsActionsTest-124054257 None] Created volume successfully.
Apr 29 10:23:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] Creating offline snapshot 5d76c60f-e622-4aeb-8a8f-2682e9813121 of volume 9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:23:23 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f253efe-4199-464f-8e2c-da2864f493b0]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:23 devstack sudo[97589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b
Apr 29 10:23:23 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:24 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b" returned: 0 in 1.019s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:24 devstack sudo[97595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 1G
Apr 29 10:23:24 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:25 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 1G" returned: 0 in 1.356s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cda0f85-4f37-4e62-995a-dec2392f168b -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:25 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:23:25 devstack sudo[97624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cda0f85-4f37-4e62-995a-dec2392f168b -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121
Apr 29 10:23:25 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Flow 'volume_create_manager' (0b742715-8731-4bd4-bacd-d55c0a70aadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:23:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b9897b-d69e-46c8-b9d0-34152744b258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b9897b-d69e-46c8-b9d0-34152744b258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1954684363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ec0fa6-89fa-447c-8225-2caab43ed40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='272edd301cc046b681de4c95d2aadb7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:23:26Z,use_quota=True,user_id='6b6888005e7c4238aa227668ec102144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b74b420-ed65-4a16-a3e8-e8cb17aa6344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b74b420-ed65-4a16-a3e8-e8cb17aa6344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e592fd6-6d19-41a5-958e-fae3cb4feeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e592fd6-6d19-41a5-958e-fae3cb4feeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ec0fa6-89fa-447c-8225-2caab43ed40d', 'volume_name': 'volume-63ec0fa6-89fa-447c-8225-2caab43ed40d', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2042a840-a020-4ed0-8369-6b2fc1498b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2042a840-a020-4ed0-8369-6b2fc1498b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff9e002-3605-4d4f-94bf-f2fb59e64209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:25 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Volume 63ec0fa6-89fa-447c-8225-2caab43ed40d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ec0fa6-89fa-447c-8225-2caab43ed40d', 'volume_size': 1}
Apr 29 10:23:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:26 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cda0f85-4f37-4e62-995a-dec2392f168b -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121" returned: 0 in 0.735s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:26 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 is being set with open permissions: ugo+rw
Apr 29 10:23:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:26 devstack sudo[97630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121
Apr 29 10:23:26 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:27 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121" returned: 0 in 1.015s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:27 devstack sudo[97696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.info
Apr 29 10:23:27 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:28 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.info" returned: 0 in 0.963s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:28 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.info is being set with open permissions: ugo+rw
Apr 29 10:23:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:28 devstack sudo[97734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.info
Apr 29 10:23:28 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:29 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.info" returned: 0 in 0.789s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.066s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.379s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1954684363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ec0fa6-89fa-447c-8225-2caab43ed40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='272edd301cc046b681de4c95d2aadb7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:23:26Z,use_quota=True,user_id='6b6888005e7c4238aa227668ec102144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:23:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Creating volume 63ec0fa6-89fa-447c-8225-2caab43ed40d {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:23:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:23:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:23:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:23:29 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:23:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63ec0fa6-89fa-447c-8225-2caab43ed40d 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:29 devstack sudo[97741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63ec0fa6-89fa-447c-8225-2caab43ed40d 1073741824
Apr 29 10:23:29 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:29 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-4c928282-11d4-4cef-9bc9-6e66d86ce78c tempest-SnapshotsActionsTest-124054257 None] Create snapshot completed successfully
Apr 29 10:23:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-32459c19-2fdf-4d9b-acd8-e312bddf3549 tempest-SnapshotsActionsTest-124054257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:30 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63ec0fa6-89fa-447c-8225-2caab43ed40d 1073741824" returned: 0 in 1.031s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63ec0fa6-89fa-447c-8225-2caab43ed40d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:30 devstack sudo[97749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63ec0fa6-89fa-447c-8225-2caab43ed40d
Apr 29 10:23:30 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:30 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63ec0fa6-89fa-447c-8225-2caab43ed40d" returned: 0 in 0.667s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:23:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-32459c19-2fdf-4d9b-acd8-e312bddf3549 tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.914s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-32459c19-2fdf-4d9b-acd8-e312bddf3549 tempest-SnapshotsActionsTest-124054257 None] Creating offline snapshot 5e202160-f389-4820-9409-8307b7a2360a of volume 9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:23:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff9e002-3605-4d4f-94bf-f2fb59e64209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ec0fa6-89fa-447c-8225-2caab43ed40d', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ee8931-f215-460f-867b-02869e311cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:31 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[00483a5a-7236-4a7c-a9d1-302ab4c9990d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32459c19-2fdf-4d9b-acd8-e312bddf3549 tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:31 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Volume volume-63ec0fa6-89fa-447c-8225-2caab43ed40d (63ec0fa6-89fa-447c-8225-2caab43ed40d): created successfully
Apr 29 10:23:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ee8931-f215-460f-867b-02869e311cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Flow 'volume_create_manager' (0b742715-8731-4bd4-bacd-d55c0a70aadb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:23:31 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d8545b33-853b-41fc-91f7-fbd388d87427 tempest-VolumesActionsTest-924915035 None] Created volume successfully.
Apr 29 10:23:31 devstack sudo[97752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121
Apr 29 10:23:31 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Acquiring lock "cinder-63ec0fa6-89fa-447c-8225-2caab43ed40d-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Lock "cinder-63ec0fa6-89fa-447c-8225-2caab43ed40d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Acquiring lock "cinder-quobyte-63ec0fa6-89fa-447c-8225-2caab43ed40d" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Lock "cinder-quobyte-63ec0fa6-89fa-447c-8225-2caab43ed40d" acquired by "delete_volume" :: waited 0.048s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:31 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[853fb04d-d7d5-4130-8c62-8f4e3acdf2d1]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63ec0fa6-89fa-447c-8225-2caab43ed40d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:31 devstack sudo[97757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63ec0fa6-89fa-447c-8225-2caab43ed40d
Apr 29 10:23:31 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:32 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32459c19-2fdf-4d9b-acd8-e312bddf3549 tempest-SnapshotsActionsTest-124054257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121" returned: 0 in 1.065s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-32459c19-2fdf-4d9b-acd8-e312bddf3549 tempest-SnapshotsActionsTest-124054257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cda0f85-4f37-4e62-995a-dec2392f168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:23:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32459c19-2fdf-4d9b-acd8-e312bddf3549 tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:32 devstack sudo[97764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a 1G
Apr 29 10:23:32 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:32 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63ec0fa6-89fa-447c-8225-2caab43ed40d" returned: 0 in 0.815s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63ec0fa6-89fa-447c-8225-2caab43ed40d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:32 devstack sudo[97769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63ec0fa6-89fa-447c-8225-2caab43ed40d
Apr 29 10:23:32 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:32 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32459c19-2fdf-4d9b-acd8-e312bddf3549 tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a 1G" returned: 0 in 0.794s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32459c19-2fdf-4d9b-acd8-e312bddf3549 tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:32 devstack sudo[97775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a
Apr 29 10:23:32 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:33 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63ec0fa6-89fa-447c-8225-2caab43ed40d" returned: 0 in 0.604s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Lock "cinder-quobyte-63ec0fa6-89fa-447c-8225-2caab43ed40d" released by "delete_volume" :: held 1.509s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:33 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Created reservations ['81180aa2-3187-4a05-b150-fe985b44f954', '6d38868d-0da9-4637-bd0c-5fa5b513d620', 'a06b94dc-687c-474b-9cf5-42338f353948', '682124b6-c083-4192-87e5-4ec9166fb0e0'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:23:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:23:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:23:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:33 devstack sudo[97779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:23:33 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:33 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32459c19-2fdf-4d9b-acd8-e312bddf3549 tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a" returned: 0 in 0.669s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:33 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-32459c19-2fdf-4d9b-acd8-e312bddf3549 tempest-SnapshotsActionsTest-124054257 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a is being set with open permissions: ugo+rw
Apr 29 10:23:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32459c19-2fdf-4d9b-acd8-e312bddf3549 tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:33 devstack sudo[97784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a
Apr 29 10:23:33 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:33 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.677s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:33 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:23:33 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Deleted volume successfully.
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a3feb667-5fd8-4f85-9919-cb9bf890e09c tempest-VolumesActionsTest-803628272 None] Lock "cinder-63ec0fa6-89fa-447c-8225-2caab43ed40d-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:34 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32459c19-2fdf-4d9b-acd8-e312bddf3549 tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a" returned: 0 in 0.717s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-32459c19-2fdf-4d9b-acd8-e312bddf3549 tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.401s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:34 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-32459c19-2fdf-4d9b-acd8-e312bddf3549 tempest-SnapshotsActionsTest-124054257 None] Create snapshot completed successfully
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Flow 'volume_create_manager' (ec9f7319-104b-4fdf-b96b-868c582ab756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c360e0-2460-4613-b21a-751b64a02934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c360e0-2460-4613-b21a-751b64a02934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-731518937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c1eaaa-2020-4988-b37c-89c140f8f409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='272edd301cc046b681de4c95d2aadb7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:23:34Z,use_quota=True,user_id='6b6888005e7c4238aa227668ec102144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b13660e-58db-4a3d-8e0c-583a9b4cfabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b13660e-58db-4a3d-8e0c-583a9b4cfabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9978e437-90ab-4a72-8794-8e236e5c81de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9978e437-90ab-4a72-8794-8e236e5c81de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c1eaaa-2020-4988-b37c-89c140f8f409', 'volume_name': 'volume-56c1eaaa-2020-4988-b37c-89c140f8f409', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0722c9c6-4e64-498c-ab90-dc721cb146cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0722c9c6-4e64-498c-ab90-dc721cb146cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb9739e-10d2-453f-af9f-336a480bb124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:34 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Volume 56c1eaaa-2020-4988-b37c-89c140f8f409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c1eaaa-2020-4988-b37c-89c140f8f409', 'volume_size': 1}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-731518937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c1eaaa-2020-4988-b37c-89c140f8f409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='272edd301cc046b681de4c95d2aadb7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:23:34Z,use_quota=True,user_id='6b6888005e7c4238aa227668ec102144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Creating volume 56c1eaaa-2020-4988-b37c-89c140f8f409 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:23:34 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:23:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-56c1eaaa-2020-4988-b37c-89c140f8f409 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:34 devstack sudo[97788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-56c1eaaa-2020-4988-b37c-89c140f8f409 1073741824
Apr 29 10:23:34 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:35 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-56c1eaaa-2020-4988-b37c-89c140f8f409 1073741824" returned: 0 in 0.824s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-56c1eaaa-2020-4988-b37c-89c140f8f409 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Acquiring lock "cinder-5e202160-f389-4820-9409-8307b7a2360a-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:35 devstack sudo[97794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-56c1eaaa-2020-4988-b37c-89c140f8f409
Apr 29 10:23:35 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-5e202160-f389-4820-9409-8307b7a2360a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Acquiring lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Acquiring lock "cinder-quobyte-5e202160-f389-4820-9409-8307b7a2360a" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-5e202160-f389-4820-9409-8307b7a2360a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Deleting offline snapshot 5e202160-f389-4820-9409-8307b7a2360a of volume 9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:23:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] snapshot_file for this snap is: volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:23:35 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[68db326a-d6f6-4a79-9d5e-fa79eb3f5baf]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:35 devstack sudo[97796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a
Apr 29 10:23:35 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:36 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-56c1eaaa-2020-4988-b37c-89c140f8f409" returned: 0 in 0.986s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:23:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb9739e-10d2-453f-af9f-336a480bb124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c1eaaa-2020-4988-b37c-89c140f8f409', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a21d3a-ddbb-49ac-8459-c2e71c197eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:36 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Volume volume-56c1eaaa-2020-4988-b37c-89c140f8f409 (56c1eaaa-2020-4988-b37c-89c140f8f409): created successfully
Apr 29 10:23:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a21d3a-ddbb-49ac-8459-c2e71c197eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Flow 'volume_create_manager' (ec9f7319-104b-4fdf-b96b-868c582ab756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:23:36 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1b92ad93-18e3-47b6-8603-9433a2f65292 tempest-VolumesActionsTest-924915035 None] Created volume successfully.
Apr 29 10:23:36 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a" returned: 0 in 1.112s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cda0f85-4f37-4e62-995a-dec2392f168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:23:36 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af5b9b2-7840-42c4-ab5f-ed20d7d06b75]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:36 devstack sudo[97802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121
Apr 29 10:23:36 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:37 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121" returned: 0 in 0.738s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cda0f85-4f37-4e62-995a-dec2392f168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:23:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:37 devstack sudo[97807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a
Apr 29 10:23:37 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:37 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Acquiring lock "cinder-56c1eaaa-2020-4988-b37c-89c140f8f409-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:37 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Lock "cinder-56c1eaaa-2020-4988-b37c-89c140f8f409-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:37 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=71,cinder:UPDATE=74,cinder:INSERT=22,cinder:DELETE=4 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:23:37 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Acquiring lock "cinder-quobyte-56c1eaaa-2020-4988-b37c-89c140f8f409" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:37 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Lock "cinder-quobyte-56c1eaaa-2020-4988-b37c-89c140f8f409" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:38 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8003b5-1599-44fb-974a-7ba3f6baa4be]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-56c1eaaa-2020-4988-b37c-89c140f8f409 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:38 devstack sudo[97809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-56c1eaaa-2020-4988-b37c-89c140f8f409
Apr 29 10:23:38 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:38 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a" returned: 0 in 0.766s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:38 devstack sudo[97815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a
Apr 29 10:23:38 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:38 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-56c1eaaa-2020-4988-b37c-89c140f8f409" returned: 0 in 0.769s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-56c1eaaa-2020-4988-b37c-89c140f8f409 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:38 devstack sudo[97821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-56c1eaaa-2020-4988-b37c-89c140f8f409
Apr 29 10:23:38 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:38 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5e202160-f389-4820-9409-8307b7a2360a" returned: 0 in 0.652s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-5e202160-f389-4820-9409-8307b7a2360a" released by "_delete_snapshot" :: held 3.403s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" released by "delete_snapshot" :: held 3.433s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:39 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=73,cinder:UPDATE=75,cinder:INSERT=9,cinder:DELETE=10 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:23:39 devstack cinder-volume[84165]: WARNING cinder.quota [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:23:39 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Created reservations ['ccf57b03-85a7-4dc0-ab7c-6b11346c64ec', 'fcf9729d-c187-4b9c-b22a-78a5084fc4fa', '81071ad9-ebc4-4a0f-a150-7006a303f8f5', '70abe321-d7b7-45e9-b0a7-cfad3a562a57'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:23:39 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Delete snapshot completed successfully.
Apr 29 10:23:39 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8a1bea82-5fcc-4b3c-be4a-ad990799ed6e tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-5e202160-f389-4820-9409-8307b7a2360a-delete_snapshot" released by "delete_snapshot" :: held 3.602s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:39 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-56c1eaaa-2020-4988-b37c-89c140f8f409" returned: 0 in 0.696s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:39 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Lock "cinder-quobyte-56c1eaaa-2020-4988-b37c-89c140f8f409" released by "delete_volume" :: held 1.510s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:39 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Created reservations ['d339acef-85d1-483a-b984-8c1975875693', '76312fc6-fe54-4537-b5a4-fea84d406789', 'a3ea6486-110b-4aee-bcd3-2dc9971b3e4b', '427b3abb-ca3b-4fdf-aa90-5aa60d3cf180'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:23:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:23:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:23:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:39 devstack sudo[97825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:23:39 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f6ef0769-08f0-4527-9e96-47f85fe4dde3 tempest-SnapshotsActionsTest-124054257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f6ef0769-08f0-4527-9e96-47f85fe4dde3 tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-f6ef0769-08f0-4527-9e96-47f85fe4dde3 tempest-SnapshotsActionsTest-124054257 None] Creating offline snapshot 99d90cd4-87ad-4390-8666-91132508ce43 of volume 9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6369465-03fc-4b4f-92d4-c84ae9c31a87]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f6ef0769-08f0-4527-9e96-47f85fe4dde3 tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:40 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.724s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:23:40 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Deleted volume successfully.
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0c556a18-ec60-4303-95ce-520d1a59b365 tempest-VolumesActionsTest-803628272 None] Lock "cinder-56c1eaaa-2020-4988-b37c-89c140f8f409-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:40 devstack sudo[97828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121
Apr 29 10:23:40 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Flow 'volume_create_manager' (2d040efb-df49-4c44-9f36-ab796ee59cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd7097f-f218-4174-87c9-59bc33c8fec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd7097f-f218-4174-87c9-59bc33c8fec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-680180761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee97e1f-7db9-4b6d-8d06-fea2cabfb286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='272edd301cc046b681de4c95d2aadb7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:23:41Z,use_quota=True,user_id='6b6888005e7c4238aa227668ec102144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2ff3c4-054b-4d46-be73-eb47846dc6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2ff3c4-054b-4d46-be73-eb47846dc6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e56e562-ff5a-45b2-9b74-352d4af21dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e56e562-ff5a-45b2-9b74-352d4af21dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ee97e1f-7db9-4b6d-8d06-fea2cabfb286', 'volume_name': 'volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd03a488-c840-4799-a164-b2c53d63a386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd03a488-c840-4799-a164-b2c53d63a386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e096f658-d65e-4576-a4b4-8b2af50b3ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:40 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Volume 3ee97e1f-7db9-4b6d-8d06-fea2cabfb286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286', 'volume_size': 1}
Apr 29 10:23:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:41 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f6ef0769-08f0-4527-9e96-47f85fe4dde3 tempest-SnapshotsActionsTest-124054257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121" returned: 0 in 0.804s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-f6ef0769-08f0-4527-9e96-47f85fe4dde3 tempest-SnapshotsActionsTest-124054257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cda0f85-4f37-4e62-995a-dec2392f168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:23:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f6ef0769-08f0-4527-9e96-47f85fe4dde3 tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:41 devstack sudo[97833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43 1G
Apr 29 10:23:41 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:41 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f6ef0769-08f0-4527-9e96-47f85fe4dde3 tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43 1G" returned: 0 in 0.811s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f6ef0769-08f0-4527-9e96-47f85fe4dde3 tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:41 devstack sudo[97853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43
Apr 29 10:23:41 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:42 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f6ef0769-08f0-4527-9e96-47f85fe4dde3 tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43" returned: 0 in 0.616s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:42 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-f6ef0769-08f0-4527-9e96-47f85fe4dde3 tempest-SnapshotsActionsTest-124054257 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43 is being set with open permissions: ugo+rw
Apr 29 10:23:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f6ef0769-08f0-4527-9e96-47f85fe4dde3 tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:42 devstack sudo[97858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43
Apr 29 10:23:42 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:43 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f6ef0769-08f0-4527-9e96-47f85fe4dde3 tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43" returned: 0 in 0.584s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f6ef0769-08f0-4527-9e96-47f85fe4dde3 tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.915s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.325s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-680180761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee97e1f-7db9-4b6d-8d06-fea2cabfb286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='272edd301cc046b681de4c95d2aadb7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:23:41Z,use_quota=True,user_id='6b6888005e7c4238aa227668ec102144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Creating volume 3ee97e1f-7db9-4b6d-8d06-fea2cabfb286 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:23:43 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:43 devstack sudo[97862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286 1073741824
Apr 29 10:23:43 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:43 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-f6ef0769-08f0-4527-9e96-47f85fe4dde3 tempest-SnapshotsActionsTest-124054257 None] Create snapshot completed successfully
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Acquiring lock "cinder-99d90cd4-87ad-4390-8666-91132508ce43-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-99d90cd4-87ad-4390-8666-91132508ce43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Acquiring lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Acquiring lock "cinder-quobyte-99d90cd4-87ad-4390-8666-91132508ce43" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-99d90cd4-87ad-4390-8666-91132508ce43" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Deleting offline snapshot 99d90cd4-87ad-4390-8666-91132508ce43 of volume 9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] snapshot_file for this snap is: volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d03b4d4-d508-425c-b271-859b3251f983]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:43 devstack sudo[97864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43
Apr 29 10:23:43 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:43 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286 1073741824" returned: 0 in 0.825s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:44 devstack sudo[97870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286
Apr 29 10:23:44 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:44 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43" returned: 0 in 0.712s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cda0f85-4f37-4e62-995a-dec2392f168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:23:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d54d41-e87a-4a11-bf58-53143c7ac2a2]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:44 devstack sudo[97875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121
Apr 29 10:23:44 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:44 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286" returned: 0 in 0.588s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:23:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e096f658-d65e-4576-a4b4-8b2af50b3ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83dd64d-6fb2-4516-8259-2f3b9eff09e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:44 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Volume volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286 (3ee97e1f-7db9-4b6d-8d06-fea2cabfb286): created successfully
Apr 29 10:23:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83dd64d-6fb2-4516-8259-2f3b9eff09e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Flow 'volume_create_manager' (2d040efb-df49-4c44-9f36-ab796ee59cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:23:44 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-292e477e-c043-4e57-b55d-83bccfa3a8d6 tempest-VolumesActionsTest-924915035 None] Created volume successfully.
Apr 29 10:23:45 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121" returned: 0 in 0.722s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cda0f85-4f37-4e62-995a-dec2392f168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:23:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:45 devstack sudo[97881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43
Apr 29 10:23:45 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Acquiring lock "cinder-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Lock "cinder-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Acquiring lock "cinder-quobyte-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Lock "cinder-quobyte-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:45 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c4d321-bfba-48ea-851e-427be79e62b2]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:45 devstack sudo[97883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286
Apr 29 10:23:45 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:45 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43" returned: 0 in 0.761s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:45 devstack sudo[97889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43
Apr 29 10:23:45 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:45 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286" returned: 0 in 0.727s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:45 devstack sudo[97894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286
Apr 29 10:23:45 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:46 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.99d90cd4-87ad-4390-8666-91132508ce43" returned: 0 in 0.646s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-99d90cd4-87ad-4390-8666-91132508ce43" released by "_delete_snapshot" :: held 2.936s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" released by "delete_snapshot" :: held 2.961s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Created reservations ['1af1f60c-8b57-4b94-aeb9-91ca5ba94212', '5229678f-ec27-4a54-9c01-4611f4aa6a56', '3a94e97b-a63c-48dc-9a52-902164150b5a', '51d23bab-35bf-4273-8087-9342dfe61347'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:23:46 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Delete snapshot completed successfully.
Apr 29 10:23:46 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286" returned: 0 in 0.613s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e364adab-1808-4b7b-9f10-e83a6ba7f68a tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-99d90cd4-87ad-4390-8666-91132508ce43-delete_snapshot" released by "delete_snapshot" :: held 3.114s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Lock "cinder-quobyte-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286" released by "delete_volume" :: held 1.388s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Created reservations ['3b263602-f84c-465c-bb06-77a2e7683c64', '24d5f6ed-6c7c-47b4-a018-1ae8beec5a0b', '66c65c1f-1e8a-426b-ad79-dadf65c6f1ff', 'ac64b527-f739-4a20-840d-d61d289af967'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:46 devstack sudo[97898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:23:46 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-998f95c6-d027-44c1-b302-160d9e1d0c8a tempest-SnapshotsActionsTest-124054257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-998f95c6-d027-44c1-b302-160d9e1d0c8a tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-998f95c6-d027-44c1-b302-160d9e1d0c8a tempest-SnapshotsActionsTest-124054257 None] Creating offline snapshot 46851c68-9eb7-431f-8f81-08204426953e of volume 9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7575b3-93bb-459c-9255-fa493a47d3bd]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-998f95c6-d027-44c1-b302-160d9e1d0c8a tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:47 devstack sudo[97900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121
Apr 29 10:23:47 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:47 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.649s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:23:47 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Deleted volume successfully.
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d3eb8e3f-e19c-4775-aee8-43af50609af7 tempest-VolumesActionsTest-803628272 None] Lock "cinder-3ee97e1f-7db9-4b6d-8d06-fea2cabfb286-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:47 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-998f95c6-d027-44c1-b302-160d9e1d0c8a tempest-SnapshotsActionsTest-124054257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121" returned: 0 in 0.768s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-998f95c6-d027-44c1-b302-160d9e1d0c8a tempest-SnapshotsActionsTest-124054257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cda0f85-4f37-4e62-995a-dec2392f168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-998f95c6-d027-44c1-b302-160d9e1d0c8a tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:47 devstack sudo[97906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e 1G
Apr 29 10:23:47 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Flow 'volume_create_manager' (6906778f-04a7-4fc7-9af7-e1a62f2ee119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e55404-1aca-4b78-8432-0fb13b6581de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e55404-1aca-4b78-8432-0fb13b6581de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-401809822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80f101c-b7ce-4ac4-899d-0add59fa7ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='272edd301cc046b681de4c95d2aadb7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:23:48Z,use_quota=True,user_id='6b6888005e7c4238aa227668ec102144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7137bc7-309c-4fad-a71a-47955c8ed57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7137bc7-309c-4fad-a71a-47955c8ed57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ff6fff-d68b-4723-a1fd-c1fc15218eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ff6fff-d68b-4723-a1fd-c1fc15218eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a80f101c-b7ce-4ac4-899d-0add59fa7ddd', 'volume_name': 'volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c14fd8-9a5f-4c41-94c0-344e8fa23ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c14fd8-9a5f-4c41-94c0-344e8fa23ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5facd4-0bec-49ad-962f-57b3c4e140ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:47 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Volume a80f101c-b7ce-4ac4-899d-0add59fa7ddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd', 'volume_size': 1}
Apr 29 10:23:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:48 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-998f95c6-d027-44c1-b302-160d9e1d0c8a tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e 1G" returned: 0 in 0.835s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-998f95c6-d027-44c1-b302-160d9e1d0c8a tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:48 devstack sudo[97912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e
Apr 29 10:23:48 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:49 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-998f95c6-d027-44c1-b302-160d9e1d0c8a tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e" returned: 0 in 0.640s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:49 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-998f95c6-d027-44c1-b302-160d9e1d0c8a tempest-SnapshotsActionsTest-124054257 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e is being set with open permissions: ugo+rw
Apr 29 10:23:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-998f95c6-d027-44c1-b302-160d9e1d0c8a tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:49 devstack sudo[97917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e
Apr 29 10:23:49 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:49 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-998f95c6-d027-44c1-b302-160d9e1d0c8a tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e" returned: 0 in 0.660s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-998f95c6-d027-44c1-b302-160d9e1d0c8a tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.066s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-401809822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80f101c-b7ce-4ac4-899d-0add59fa7ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='272edd301cc046b681de4c95d2aadb7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:23:48Z,use_quota=True,user_id='6b6888005e7c4238aa227668ec102144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:23:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Creating volume a80f101c-b7ce-4ac4-899d-0add59fa7ddd {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:23:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:23:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:23:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:23:49 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:23:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:50 devstack sudo[97920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd 1073741824
Apr 29 10:23:50 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:50 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-998f95c6-d027-44c1-b302-160d9e1d0c8a tempest-SnapshotsActionsTest-124054257 None] Create snapshot completed successfully
Apr 29 10:23:50 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd 1073741824" returned: 0 in 0.757s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:50 devstack sudo[97925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd
Apr 29 10:23:50 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Acquiring lock "cinder-46851c68-9eb7-431f-8f81-08204426953e-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-46851c68-9eb7-431f-8f81-08204426953e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Acquiring lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Acquiring lock "cinder-quobyte-46851c68-9eb7-431f-8f81-08204426953e" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-46851c68-9eb7-431f-8f81-08204426953e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Deleting offline snapshot 46851c68-9eb7-431f-8f81-08204426953e of volume 9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] snapshot_file for this snap is: volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d3a368-fb2a-46a0-992c-c9ab9978670c]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:51 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd" returned: 0 in 0.626s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5facd4-0bec-49ad-962f-57b3c4e140ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5824b6bd-778b-49b0-8512-47a656287b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:51 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Volume volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd (a80f101c-b7ce-4ac4-899d-0add59fa7ddd): created successfully
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5824b6bd-778b-49b0-8512-47a656287b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:51 devstack sudo[97928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e
Apr 29 10:23:51 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Flow 'volume_create_manager' (6906778f-04a7-4fc7-9af7-e1a62f2ee119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:23:51 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c8e84fa6-81bc-47cc-87bd-2769306d6c1e tempest-VolumesActionsTest-924915035 None] Created volume successfully.
Apr 29 10:23:52 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e" returned: 0 in 0.761s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cda0f85-4f37-4e62-995a-dec2392f168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:23:52 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef47abcc-061e-45c0-afdc-e80b36a8faee]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:52 devstack sudo[97937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121
Apr 29 10:23:52 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Acquiring lock "cinder-a80f101c-b7ce-4ac4-899d-0add59fa7ddd-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Lock "cinder-a80f101c-b7ce-4ac4-899d-0add59fa7ddd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Acquiring lock "cinder-quobyte-a80f101c-b7ce-4ac4-899d-0add59fa7ddd" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Lock "cinder-quobyte-a80f101c-b7ce-4ac4-899d-0add59fa7ddd" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:52 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11d3a04-f1f2-43da-99e8-a70b89b4cebd]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:52 devstack sudo[97939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd
Apr 29 10:23:52 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:52 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121" returned: 0 in 0.843s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cda0f85-4f37-4e62-995a-dec2392f168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:23:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:53 devstack sudo[97945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e
Apr 29 10:23:53 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:53 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd" returned: 0 in 0.712s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:53 devstack sudo[97950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd
Apr 29 10:23:53 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:53 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-35727b28-61da-4211-ba80-275b244bcf72 req-f6aad6f7-f5ab-4e6a-92f3-2f640452359a tempest-ServerRescueNegativeTestJSON-1128993470 None] Terminate volume connection completed successfully.
Apr 29 10:23:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-35727b28-61da-4211-ba80-275b244bcf72 req-f6aad6f7-f5ab-4e6a-92f3-2f640452359a tempest-ServerRescueNegativeTestJSON-1128993470 None] Deleting attachment c6aa35eb-145e-470e-b429-59d395823b9d. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:23:53 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e" returned: 0 in 0.831s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:53 devstack sudo[97960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e
Apr 29 10:23:53 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:53 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a80f101c-b7ce-4ac4-899d-0add59fa7ddd" returned: 0 in 0.709s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Lock "cinder-quobyte-a80f101c-b7ce-4ac4-899d-0add59fa7ddd" released by "delete_volume" :: held 1.481s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:53 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-916c81fa-d4c7-49e8-8389-62490cfd02a7 req-c78d7722-e1cb-434f-80eb-86990fc24d1a tempest-AttachVolumeShelveTestJSON-921790343 None] Terminate volume connection completed successfully.
Apr 29 10:23:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-916c81fa-d4c7-49e8-8389-62490cfd02a7 req-c78d7722-e1cb-434f-80eb-86990fc24d1a tempest-AttachVolumeShelveTestJSON-921790343 None] Deleting attachment 001610cf-d010-4cd0-8bf3-f87340a2dca4. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:23:53 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Created reservations ['44fd5a74-d0f4-40c1-b46b-614d445453ab', '41bb93b3-57da-4591-a0f0-0da01c2c4a8f', 'c3509a50-4ca3-41d9-86d4-2a552d8e6edb', '86b958eb-94be-42ac-941a-c31dbd83e1ba'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:23:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:23:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:23:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:54 devstack sudo[97964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:23:54 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:54 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.46851c68-9eb7-431f-8f81-08204426953e" returned: 0 in 0.665s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-46851c68-9eb7-431f-8f81-08204426953e" released by "_delete_snapshot" :: held 3.233s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" released by "delete_snapshot" :: held 3.264s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:54 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Created reservations ['e1b8a677-47a4-46e7-a7c9-e3afef5d0173', '29129928-2b66-47de-92d1-2fdbf10b477e', '9f45df9e-0619-4482-93db-d91e6a7b91df', '715448d5-60c4-4c89-91ed-96ac089ebecb'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:23:54 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Delete snapshot completed successfully.
Apr 29 10:23:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-70001b88-ae5b-42b3-b5dc-b2ab798a9d4e tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-46851c68-9eb7-431f-8f81-08204426953e-delete_snapshot" released by "delete_snapshot" :: held 3.455s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:54 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.650s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:54 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:23:54 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Deleted volume successfully.
Apr 29 10:23:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8ba73400-e17c-4d8e-adc3-287334762652 tempest-VolumesActionsTest-803628272 None] Lock "cinder-a80f101c-b7ce-4ac4-899d-0add59fa7ddd-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Flow 'volume_create_manager' (aaa66a23-d7df-4b40-bbe2-fdc5d0363af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27df54b4-901c-4478-92db-b5f4811c66bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27df54b4-901c-4478-92db-b5f4811c66bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-412465688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e17379-d412-482f-9af2-234dad4fd5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='272edd301cc046b681de4c95d2aadb7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:23:55Z,use_quota=True,user_id='6b6888005e7c4238aa227668ec102144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1df99b3-0b97-49c2-b630-f4cf5036274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1df99b3-0b97-49c2-b630-f4cf5036274a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40fd66c3-7e8c-4303-b3a6-87bc95a5c24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40fd66c3-7e8c-4303-b3a6-87bc95a5c24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e17379-d412-482f-9af2-234dad4fd5be', 'volume_name': 'volume-17e17379-d412-482f-9af2-234dad4fd5be', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecd8698-06a8-46f0-87fe-232c211b9dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecd8698-06a8-46f0-87fe-232c211b9dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2893c451-dc01-4838-8860-7a90b882de3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:55 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Volume 17e17379-d412-482f-9af2-234dad4fd5be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e17379-d412-482f-9af2-234dad4fd5be', 'volume_size': 1}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-412465688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e17379-d412-482f-9af2-234dad4fd5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='272edd301cc046b681de4c95d2aadb7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:23:55Z,use_quota=True,user_id='6b6888005e7c4238aa227668ec102144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Creating volume 17e17379-d412-482f-9af2-234dad4fd5be {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:23:55 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17e17379-d412-482f-9af2-234dad4fd5be 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:55 devstack sudo[97968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17e17379-d412-482f-9af2-234dad4fd5be 1073741824
Apr 29 10:23:55 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8219a429-8a7e-4e79-9ac3-32f843b5f30b tempest-SnapshotsActionsTest-124054257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:23:56 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17e17379-d412-482f-9af2-234dad4fd5be 1073741824" returned: 0 in 1.032s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17e17379-d412-482f-9af2-234dad4fd5be {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:56 devstack sudo[97973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17e17379-d412-482f-9af2-234dad4fd5be
Apr 29 10:23:56 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:56 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17e17379-d412-482f-9af2-234dad4fd5be" returned: 0 in 0.620s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:23:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:23:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8219a429-8a7e-4e79-9ac3-32f843b5f30b tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.023s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:23:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8219a429-8a7e-4e79-9ac3-32f843b5f30b tempest-SnapshotsActionsTest-124054257 None] Creating offline snapshot 910e1c61-48d4-4415-a54b-dd0aa29066fa of volume 9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:23:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2893c451-dc01-4838-8860-7a90b882de3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e17379-d412-482f-9af2-234dad4fd5be', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bece973-0a30-4df6-ba61-2e1f2ec5ac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:23:56 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a38a827-6956-4662-96b4-f9e7a375bdfe]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8219a429-8a7e-4e79-9ac3-32f843b5f30b tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:56 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Volume volume-17e17379-d412-482f-9af2-234dad4fd5be (17e17379-d412-482f-9af2-234dad4fd5be): created successfully
Apr 29 10:23:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bece973-0a30-4df6-ba61-2e1f2ec5ac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:23:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Flow 'volume_create_manager' (aaa66a23-d7df-4b40-bbe2-fdc5d0363af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:23:56 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e7cb5273-be5a-4513-ba31-c492c680eb8c tempest-VolumesActionsTest-924915035 None] Created volume successfully.
Apr 29 10:23:57 devstack sudo[97976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121
Apr 29 10:23:57 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:58 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8219a429-8a7e-4e79-9ac3-32f843b5f30b tempest-SnapshotsActionsTest-124054257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121" returned: 0 in 1.415s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8219a429-8a7e-4e79-9ac3-32f843b5f30b tempest-SnapshotsActionsTest-124054257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cda0f85-4f37-4e62-995a-dec2392f168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:23:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8219a429-8a7e-4e79-9ac3-32f843b5f30b tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:58 devstack sudo[98070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa 1G
Apr 29 10:23:58 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Acquiring lock "cinder-17e17379-d412-482f-9af2-234dad4fd5be-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Lock "cinder-17e17379-d412-482f-9af2-234dad4fd5be-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Acquiring lock "cinder-quobyte-17e17379-d412-482f-9af2-234dad4fd5be" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:23:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Lock "cinder-quobyte-17e17379-d412-482f-9af2-234dad4fd5be" acquired by "delete_volume" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:23:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88b0f0c-c82b-4ea5-bfea-67c4adcb89b8]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:23:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17e17379-d412-482f-9af2-234dad4fd5be {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:58 devstack sudo[98073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17e17379-d412-482f-9af2-234dad4fd5be
Apr 29 10:23:58 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:59 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8219a429-8a7e-4e79-9ac3-32f843b5f30b tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa 1G" returned: 0 in 1.100s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8219a429-8a7e-4e79-9ac3-32f843b5f30b tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:59 devstack sudo[98085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa
Apr 29 10:23:59 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:23:59 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root
Apr 29 10:23:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17e17379-d412-482f-9af2-234dad4fd5be" returned: 0 in 0.925s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:23:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17e17379-d412-482f-9af2-234dad4fd5be {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:23:59 devstack sudo[98090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17e17379-d412-482f-9af2-234dad4fd5be
Apr 29 10:23:59 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:00 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8219a429-8a7e-4e79-9ac3-32f843b5f30b tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa" returned: 0 in 0.693s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:00 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-8219a429-8a7e-4e79-9ac3-32f843b5f30b tempest-SnapshotsActionsTest-124054257 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa is being set with open permissions: ugo+rw
Apr 29 10:24:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8219a429-8a7e-4e79-9ac3-32f843b5f30b tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:00 devstack sudo[98096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa
Apr 29 10:24:00 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:00 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17e17379-d412-482f-9af2-234dad4fd5be" returned: 0 in 0.708s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Lock "cinder-quobyte-17e17379-d412-482f-9af2-234dad4fd5be" released by "delete_volume" :: held 1.707s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:00 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Created reservations ['fae07b6f-e10b-453e-a720-dc92a949987a', 'b44a13f8-d5dd-4e69-9e9e-e6558549a15a', '0d6668c5-87fe-4bd4-8c5e-fddbe038ed1d', '50054dc6-5a40-4113-8a73-b6e50bde8911'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:24:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:24:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:24:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:00 devstack sudo[98099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:24:00 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:00 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8219a429-8a7e-4e79-9ac3-32f843b5f30b tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa" returned: 0 in 0.645s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8219a429-8a7e-4e79-9ac3-32f843b5f30b tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.978s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:00 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8219a429-8a7e-4e79-9ac3-32f843b5f30b tempest-SnapshotsActionsTest-124054257 None] Create snapshot completed successfully
Apr 29 10:24:01 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.673s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:01 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:24:01 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Deleted volume successfully.
Apr 29 10:24:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a01d306f-a5ba-4099-9563-90af571301b6 tempest-VolumesActionsTest-924915035 None] Lock "cinder-17e17379-d412-482f-9af2-234dad4fd5be-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Acquiring lock "cinder-910e1c61-48d4-4415-a54b-dd0aa29066fa-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-910e1c61-48d4-4415-a54b-dd0aa29066fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Acquiring lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Acquiring lock "cinder-quobyte-910e1c61-48d4-4415-a54b-dd0aa29066fa" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-910e1c61-48d4-4415-a54b-dd0aa29066fa" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Deleting offline snapshot 910e1c61-48d4-4415-a54b-dd0aa29066fa of volume 9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:24:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] snapshot_file for this snap is: volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:24:01 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b3fe12-c6ef-4b0b-a5dd-b604f78addb7]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:24:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:01 devstack sudo[98103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa
Apr 29 10:24:01 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:02 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa" returned: 0 in 0.754s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cda0f85-4f37-4e62-995a-dec2392f168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:24:02 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac074001-b93b-43c8-b425-4fbc0f4ceacc]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:24:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:02 devstack sudo[98108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121
Apr 29 10:24:02 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:02 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121" returned: 0 in 0.764s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cda0f85-4f37-4e62-995a-dec2392f168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:24:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:02 devstack sudo[98114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa
Apr 29 10:24:02 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:03 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa" returned: 0 in 0.935s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:03 devstack sudo[98121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa
Apr 29 10:24:03 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Acquiring lock "cinder-488ca91b-d201-4006-aed2-c43e6aa7f7bb-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "cinder-488ca91b-d201-4006-aed2-c43e6aa7f7bb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Acquiring lock "cinder-quobyte-488ca91b-d201-4006-aed2-c43e6aa7f7bb" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "cinder-quobyte-488ca91b-d201-4006-aed2-c43e6aa7f7bb" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:04 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fe0654-28e7-4331-8145-c29d19000eb7]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:24:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:04 devstack sudo[98123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb
Apr 29 10:24:04 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:04 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.910e1c61-48d4-4415-a54b-dd0aa29066fa" returned: 0 in 0.787s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-910e1c61-48d4-4415-a54b-dd0aa29066fa" released by "_delete_snapshot" :: held 3.341s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" released by "delete_snapshot" :: held 3.368s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:04 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Created reservations ['bfedb039-f850-47ea-9da9-da7876e29f22', '8f5f2277-bba9-40b0-9c81-c7fe72816f03', '9b4faf15-b262-473a-91bd-be44dc747654', '1e40fe76-9c0f-4213-a346-219c8067986c'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:24:04 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Delete snapshot completed successfully.
Apr 29 10:24:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9a5c87ac-11ad-4bb8-b85d-8af7b68145d5 tempest-SnapshotsActionsTest-1963867183 None] Lock "cinder-910e1c61-48d4-4415-a54b-dd0aa29066fa-delete_snapshot" released by "delete_snapshot" :: held 3.569s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:04 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb" returned: 0 in 0.899s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:05 devstack sudo[98130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb
Apr 29 10:24:05 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:24:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:24:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:24:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:05 devstack sudo[98132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:24:05 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:05 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-488ca91b-d201-4006-aed2-c43e6aa7f7bb" returned: 0 in 0.802s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "cinder-quobyte-488ca91b-d201-4006-aed2-c43e6aa7f7bb" released by "delete_volume" :: held 1.788s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:05 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Created reservations ['bf50482b-9014-4dd3-95b8-546e458377fd', '1e93bb61-80f4-4291-9b64-73a36bf140be', '06d9b0ef-e1de-4bb8-a660-a916c3eaa123', 'e8555085-58b1-4555-9ec0-52cc2d6f93ed'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:06 devstack sudo[98135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:24:06 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Acquiring lock "cinder-5d76c60f-e622-4aeb-8a8f-2682e9813121-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Acquiring lock "cinder-46e3b3a5-1678-4660-8c9a-826fcd7d8713-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Lock "cinder-5d76c60f-e622-4aeb-8a8f-2682e9813121-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Acquiring lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "cinder-46e3b3a5-1678-4660-8c9a-826fcd7d8713-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" acquired by "delete_snapshot" :: waited 0.041s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Acquiring lock "cinder-quobyte-5d76c60f-e622-4aeb-8a8f-2682e9813121" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Lock "cinder-quobyte-5d76c60f-e622-4aeb-8a8f-2682e9813121" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Deleting offline snapshot 5d76c60f-e622-4aeb-8a8f-2682e9813121 of volume 9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] snapshot_file for this snap is: volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[de53806b-4d99-4508-ade8-688b09c6908b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Acquiring lock "cinder-quobyte-46e3b3a5-1678-4660-8c9a-826fcd7d8713" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:06 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.083s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "cinder-quobyte-46e3b3a5-1678-4660-8c9a-826fcd7d8713" acquired by "delete_volume" :: waited 0.057s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c189bac7-d528-44b0-af27-7ff5f8e70834]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:24:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:06 devstack sudo[98139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713
Apr 29 10:24:06 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:06 devstack sudo[98138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121
Apr 29 10:24:06 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:07 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.143s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:07 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:24:07 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Deleted volume successfully.
Apr 29 10:24:07 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-10fb3fba-7b6a-493c-a749-b50270795672 tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "cinder-488ca91b-d201-4006-aed2-c43e6aa7f7bb-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:07 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713" returned: 0 in 0.861s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:07 devstack sudo[98150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713
Apr 29 10:24:07 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:07 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121" returned: 0 in 1.128s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cda0f85-4f37-4e62-995a-dec2392f168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:24:07 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce7fdef-4566-44e8-bfdc-189e768e068d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:24:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:07 devstack sudo[98153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b
Apr 29 10:24:07 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:08 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-46e3b3a5-1678-4660-8c9a-826fcd7d8713" returned: 0 in 0.729s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:08 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "cinder-quobyte-46e3b3a5-1678-4660-8c9a-826fcd7d8713" released by "delete_volume" :: held 1.651s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:08 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Created reservations ['8f54bf83-6289-441b-b8dd-e0ffa4ec4e36', '79526d7e-bbcf-4796-b3d4-df4bf477b314', '3754d902-c17b-48dd-adb0-2b31e5644307', 'f39cc107-4d66-4bc8-bbbb-14fd46340eb7'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:24:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:24:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:24:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:08 devstack sudo[98156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:24:08 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:08 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b" returned: 0 in 0.910s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:08 devstack sudo[98161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121
Apr 29 10:24:08 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:09 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.953s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:09 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:24:09 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Deleted volume successfully.
Apr 29 10:24:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4392b1fc-6f27-4929-9736-6d53ef6d532c tempest-ServerRescueNegativeTestJSON-1128993470 None] Lock "cinder-46e3b3a5-1678-4660-8c9a-826fcd7d8713-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:09 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121" returned: 0 in 1.125s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:09 devstack sudo[98171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121
Apr 29 10:24:09 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:10 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b.5d76c60f-e622-4aeb-8a8f-2682e9813121" returned: 0 in 0.834s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Lock "cinder-quobyte-5d76c60f-e622-4aeb-8a8f-2682e9813121" released by "_delete_snapshot" :: held 4.196s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" released by "delete_snapshot" :: held 4.256s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:10 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Created reservations ['e9bd0b9f-96ca-4997-bef0-12100c295d4a', '3e2d7377-5386-4d16-9a7d-4c3af996cadf', '2ec4a4f6-dc2f-4008-b9d6-56b3669c7b8b', 'a961e6e1-b460-4478-b1b9-f8a992c6dff9'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:24:10 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Delete snapshot completed successfully.
Apr 29 10:24:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a161cb90-cf1e-40d9-9653-72c32298cef2 tempest-SnapshotsActionsTest-124054257 None] Lock "cinder-5d76c60f-e622-4aeb-8a8f-2682e9813121-delete_snapshot" released by "delete_snapshot" :: held 4.555s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Acquiring lock "cinder-9cda0f85-4f37-4e62-995a-dec2392f168b-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Lock "cinder-9cda0f85-4f37-4e62-995a-dec2392f168b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Acquiring lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:11 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[417994a6-67d7-463b-afb0-0f6181be5aed]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:24:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:12 devstack sudo[98210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b
Apr 29 10:24:12 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:12 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b" returned: 0 in 0.768s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:12 devstack sudo[98215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b
Apr 29 10:24:12 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:13 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9cda0f85-4f37-4e62-995a-dec2392f168b" returned: 0 in 0.639s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:13 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Lock "cinder-quobyte-9cda0f85-4f37-4e62-995a-dec2392f168b" released by "delete_volume" :: held 1.504s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:13 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Created reservations ['ef7a4730-e2d1-4ff4-a508-1c728b9ae1a8', '17246f79-236c-415e-94da-4285f5e40401', '76925fab-599a-4f6f-8b9b-89e7a9588637', 'f2e05040-abde-4dc7-93df-199c7fb89803'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:24:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:24:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:24:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:13 devstack sudo[98219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:24:13 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:14 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.731s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:14 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:24:14 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Deleted volume successfully.
Apr 29 10:24:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-181c53d1-cf24-4601-bda3-4d021a74f41a tempest-SnapshotsActionsTest-124054257 None] Lock "cinder-9cda0f85-4f37-4e62-995a-dec2392f168b-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=74,cinder:INSERT=25,cinder:UPDATE=96,cinder:DELETE=5 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Flow 'volume_create_manager' (b0366a27-d41b-4c1c-a03d-8b3ebdee017b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cb7f8f-97e0-4d47-886c-60fd14268eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cb7f8f-97e0-4d47-886c-60fd14268eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-447556523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ded3a2-6230-4a82-827a-737b1fb84be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e5baee78a384a3bab595ec45405f6f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:24:24Z,use_quota=True,user_id='d57a0a3389ec44c999596ed6c998d693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3425dce2-f273-402d-b7f4-44dcc0dc1bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3425dce2-f273-402d-b7f4-44dcc0dc1bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e1f900-9fce-444e-8777-35ee7f3e6377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e1f900-9fce-444e-8777-35ee7f3e6377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74ded3a2-6230-4a82-827a-737b1fb84be2', 'volume_name': 'volume-74ded3a2-6230-4a82-827a-737b1fb84be2', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94e9a37-ff0e-4b67-a083-86a5f8257394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94e9a37-ff0e-4b67-a083-86a5f8257394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db4f707-4c65-4917-bb29-c3eeafedad29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:23 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Volume 74ded3a2-6230-4a82-827a-737b1fb84be2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74ded3a2-6230-4a82-827a-737b1fb84be2', 'volume_size': 1}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-447556523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ded3a2-6230-4a82-827a-737b1fb84be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e5baee78a384a3bab595ec45405f6f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:24:24Z,use_quota=True,user_id='d57a0a3389ec44c999596ed6c998d693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Creating volume 74ded3a2-6230-4a82-827a-737b1fb84be2 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:24:23 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:24:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-74ded3a2-6230-4a82-827a-737b1fb84be2 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:23 devstack sudo[98379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-74ded3a2-6230-4a82-827a-737b1fb84be2 1073741824
Apr 29 10:24:23 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:25 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-74ded3a2-6230-4a82-827a-737b1fb84be2 1073741824" returned: 0 in 1.259s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-74ded3a2-6230-4a82-827a-737b1fb84be2 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:25 devstack sudo[98399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-74ded3a2-6230-4a82-827a-737b1fb84be2
Apr 29 10:24:25 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:25 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-74ded3a2-6230-4a82-827a-737b1fb84be2" returned: 0 in 0.732s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:24:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db4f707-4c65-4917-bb29-c3eeafedad29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74ded3a2-6230-4a82-827a-737b1fb84be2', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c68eb8-0153-4539-a4df-f6c30bcf02d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:25 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Volume volume-74ded3a2-6230-4a82-827a-737b1fb84be2 (74ded3a2-6230-4a82-827a-737b1fb84be2): created successfully
Apr 29 10:24:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c68eb8-0153-4539-a4df-f6c30bcf02d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Flow 'volume_create_manager' (b0366a27-d41b-4c1c-a03d-8b3ebdee017b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:24:25 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d291e75b-4c2c-43ac-8f22-b0a7b3ab5f1c tempest-VolumeQuotasAdminTestJSON-1837114632 None] Created volume successfully.
Apr 29 10:24:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Acquiring lock "cinder-74ded3a2-6230-4a82-827a-737b1fb84be2-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Lock "cinder-74ded3a2-6230-4a82-827a-737b1fb84be2-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Acquiring lock "cinder-quobyte-74ded3a2-6230-4a82-827a-737b1fb84be2" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Lock "cinder-quobyte-74ded3a2-6230-4a82-827a-737b1fb84be2" acquired by "delete_volume" :: waited 0.049s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:27 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6780af10-cd72-471d-826d-99bc39b89641]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:24:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-74ded3a2-6230-4a82-827a-737b1fb84be2 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:27 devstack sudo[98406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-74ded3a2-6230-4a82-827a-737b1fb84be2
Apr 29 10:24:27 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Flow 'volume_create_manager' (dbca18ce-d48b-4192-8f96-9617f6d8db90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5323ec7f-bb09-4ee6-b83d-0352ba74c01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5323ec7f-bb09-4ee6-b83d-0352ba74c01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-479339848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dff1fe1-32dc-4e72-ad9d-f61db63ad86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0149f7a5f32147f798bcb7c4f4e5d6b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:24:29Z,use_quota=True,user_id='312f83c907f848b2bf3f4c4079600039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0c952b-1e90-4d36-b40a-6ae636f12839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0c952b-1e90-4d36-b40a-6ae636f12839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:28 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785c8182-87a3-4d10-ba68-cf0cc61c637b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785c8182-87a3-4d10-ba68-cf0cc61c637b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dff1fe1-32dc-4e72-ad9d-f61db63ad86c', 'volume_name': 'volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55078f9d-760b-4126-92e5-d49bf8ba2352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55078f9d-760b-4126-92e5-d49bf8ba2352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dddba734-cac9-4ff0-859f-e841268d812c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:28 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Volume 8dff1fe1-32dc-4e72-ad9d-f61db63ad86c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c', 'volume_size': 1}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-479339848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dff1fe1-32dc-4e72-ad9d-f61db63ad86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0149f7a5f32147f798bcb7c4f4e5d6b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:24:29Z,use_quota=True,user_id='312f83c907f848b2bf3f4c4079600039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Creating volume 8dff1fe1-32dc-4e72-ad9d-f61db63ad86c {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:24:28 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-74ded3a2-6230-4a82-827a-737b1fb84be2" returned: 0 in 1.235s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-74ded3a2-6230-4a82-827a-737b1fb84be2 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:28 devstack sudo[98412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c 1073741824
Apr 29 10:24:28 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:28 devstack sudo[98413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-74ded3a2-6230-4a82-827a-737b1fb84be2
Apr 29 10:24:28 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:29 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-74ded3a2-6230-4a82-827a-737b1fb84be2" returned: 0 in 1.042s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Lock "cinder-quobyte-74ded3a2-6230-4a82-827a-737b1fb84be2" released by "delete_volume" :: held 2.369s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:29 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Created reservations ['9cfaaa55-6ee4-4fbd-aeef-9877721c0344', '0a099192-0d9c-4a47-943d-174acaacca86', '72f9151b-c622-4432-9a15-1de65c48b854', 'cba775a5-b059-4e08-9f28-c4995e9f2e8a'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:24:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:24:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:24:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:30 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c 1073741824" returned: 0 in 1.327s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:30 devstack sudo[98420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:24:30 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:30 devstack sudo[98423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c
Apr 29 10:24:30 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:31 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.043s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:24:31 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Deleted volume successfully.
Apr 29 10:24:31 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-32e167ce-352f-468d-a797-47b723fa46a3 tempest-VolumeQuotasAdminTestJSON-1837114632 None] Lock "cinder-74ded3a2-6230-4a82-827a-737b1fb84be2-delete_volume" released by "delete_volume" :: held 3.896s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" returned: 0 in 1.092s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] <== create_volume: return (2485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.488s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dddba734-cac9-4ff0-859f-e841268d812c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fcc7d0-bad0-4d82-88e9-afed5468afb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:31 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Volume volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c (8dff1fe1-32dc-4e72-ad9d-f61db63ad86c): created successfully
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fcc7d0-bad0-4d82-88e9-afed5468afb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Flow 'volume_create_manager' (dbca18ce-d48b-4192-8f96-9617f6d8db90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:24:31 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-4ca0cf09-c92d-410d-9788-374f61a17ed6 tempest-VolumesActionsTest-1987562347 None] Created volume successfully.
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Flow 'volume_create_manager' (1590aeb6-371b-4e93-959f-243b07139d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76516daa-c11a-47cc-8c36-3862c7664d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76516daa-c11a-47cc-8c36-3862c7664d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1012178275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9092e5e-79e7-4671-b8fb-4fbb1be9c71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e5baee78a384a3bab595ec45405f6f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:24:32Z,use_quota=True,user_id='d57a0a3389ec44c999596ed6c998d693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e18a11-3578-4569-85e9-5dd2c33ef934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e18a11-3578-4569-85e9-5dd2c33ef934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e1d11b-e8dc-413d-8763-4b47948a08b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e1d11b-e8dc-413d-8763-4b47948a08b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9092e5e-79e7-4671-b8fb-4fbb1be9c71e', 'volume_name': 'volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d0f78c-cdfa-4936-8183-387701d5b68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d0f78c-cdfa-4936-8183-387701d5b68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c7985e-b9e7-403f-89ed-2f0bac26a9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:31 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Volume b9092e5e-79e7-4671-b8fb-4fbb1be9c71e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e', 'volume_size': 1}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1012178275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9092e5e-79e7-4671-b8fb-4fbb1be9c71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e5baee78a384a3bab595ec45405f6f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:24:32Z,use_quota=True,user_id='d57a0a3389ec44c999596ed6c998d693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Creating volume b9092e5e-79e7-4671-b8fb-4fbb1be9c71e {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:24:31 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:24:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:31 devstack sudo[98429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e 1073741824
Apr 29 10:24:31 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:32 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e 1073741824" returned: 0 in 1.030s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:32 devstack sudo[98435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e
Apr 29 10:24:32 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:33 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e" returned: 0 in 1.090s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:24:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.180s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c7985e-b9e7-403f-89ed-2f0bac26a9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24920b56-96e8-4d9a-bd8d-82ac32541e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:33 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Volume volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e (b9092e5e-79e7-4671-b8fb-4fbb1be9c71e): created successfully
Apr 29 10:24:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24920b56-96e8-4d9a-bd8d-82ac32541e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Flow 'volume_create_manager' (1590aeb6-371b-4e93-959f-243b07139d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:24:34 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-01a74d26-01ea-4d70-b269-1cebcf68509e tempest-VolumeQuotasAdminTestJSON-1837114632 None] Created volume successfully.
Apr 29 10:24:35 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-39485a6a-c4da-4a31-82a9-0a3d86abe5bd tempest-VolumeQuotasAdminTestJSON-1788641224 None] Transfer volume completed successfully.
Apr 29 10:24:36 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Acquiring lock "cinder-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:36 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Lock "cinder-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:36 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Acquiring lock "cinder-quobyte-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:36 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Lock "cinder-quobyte-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e" acquired by "delete_volume" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:37 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[005d7574-7473-4531-b160-38ea6a62546b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:24:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:37 devstack sudo[98442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e
Apr 29 10:24:37 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:37 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e" returned: 0 in 0.861s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:37 devstack sudo[98447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e
Apr 29 10:24:37 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:38 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e" returned: 0 in 1.086s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Lock "cinder-quobyte-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e" released by "delete_volume" :: held 2.024s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:39 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=81,cinder:INSERT=29,cinder:UPDATE=113,cinder:DELETE=11 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:24:39 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Created reservations ['80219444-88f7-4d7d-bb68-e85b254e64a7', '45b865e0-f612-4e9c-8b90-9afbc47e30a2', 'cdda5c99-9332-4d46-86c7-94fdf838df65', '258773d6-e849-46e5-9a53-e382102e1137'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:24:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:24:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:24:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:39 devstack sudo[98470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:24:39 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:39 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.711s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:39 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:24:39 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Deleted volume successfully.
Apr 29 10:24:39 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-57365a61-e35f-4090-aa41-d141c8b68104 tempest-VolumeQuotasAdminTestJSON-869910459 None] Lock "cinder-b9092e5e-79e7-4671-b8fb-4fbb1be9c71e-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:43 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-91094e0f-6c03-4b44-bce3-3dcdf9e757e9 tempest-GroupSnapshotsV319Test-151676271 None] Group tempest-GroupSnapshotsV319Test-Group-1822237230: creating
Apr 29 10:24:43 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-91094e0f-6c03-4b44-bce3-3dcdf9e757e9 tempest-GroupSnapshotsV319Test-151676271 None] Group tempest-GroupSnapshotsV319Test-Group-1822237230: created successfully
Apr 29 10:24:43 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-91094e0f-6c03-4b44-bce3-3dcdf9e757e9 tempest-GroupSnapshotsV319Test-151676271 None] Create group completed successfully.
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Flow 'volume_create_manager' (1cbbba1f-a9e0-4a64-8e74-4d78d8cf2280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5134862f-1952-4779-9057-fb51aa9aa52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5134862f-1952-4779-9057-fb51aa9aa52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-182558054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=014beb20-c1c0-4d54-87e8-aa656efb533d,host='devstack@QuobyteHD#QuobyteHD',id=e3a5a8a4-a0fb-4993-8547-24868223b005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01cec46067244b21b6e140d448d6ae87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:24:45Z,use_quota=True,user_id='19eba88a7a9f426eaede0d741f9469c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f25ce1c2-038e-4fb9-aedd-bb7737818196),volume_type_id=f25ce1c2-038e-4fb9-aedd-bb7737818196)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b9411e-6ff7-462b-80c2-84858454aca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b9411e-6ff7-462b-80c2-84858454aca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c708b0b-918c-44f3-84a3-d55277ee0143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c708b0b-918c-44f3-84a3-d55277ee0143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a5a8a4-a0fb-4993-8547-24868223b005', 'volume_name': 'volume-e3a5a8a4-a0fb-4993-8547-24868223b005', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7274c50d-3efc-4b11-a63b-af0f5734663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7274c50d-3efc-4b11-a63b-af0f5734663d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3cae361-0eca-4a26-87a7-df8763d800d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:45 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Volume e3a5a8a4-a0fb-4993-8547-24868223b005: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a5a8a4-a0fb-4993-8547-24868223b005', 'volume_size': 1}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=014beb20-c1c0-4d54-87e8-aa656efb533d,created_at=2026-04-29T08:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-182558054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=014beb20-c1c0-4d54-87e8-aa656efb533d,host='devstack@QuobyteHD#QuobyteHD',id=e3a5a8a4-a0fb-4993-8547-24868223b005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01cec46067244b21b6e140d448d6ae87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:24:45Z,use_quota=True,user_id='19eba88a7a9f426eaede0d741f9469c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f25ce1c2-038e-4fb9-aedd-bb7737818196),volume_type_id=f25ce1c2-038e-4fb9-aedd-bb7737818196)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Creating volume e3a5a8a4-a0fb-4993-8547-24868223b005 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:24:45 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:24:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:45 devstack sudo[98494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005 1073741824
Apr 29 10:24:45 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:47 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005 1073741824" returned: 0 in 1.737s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:47 devstack sudo[98565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005
Apr 29 10:24:47 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:47 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005" returned: 0 in 0.730s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] <== create_volume: return (2524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:24:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.527s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3cae361-0eca-4a26-87a7-df8763d800d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a5a8a4-a0fb-4993-8547-24868223b005', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1d21a0-bc4a-4a15-934e-84e7a0fc0049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:47 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Volume volume-e3a5a8a4-a0fb-4993-8547-24868223b005 (e3a5a8a4-a0fb-4993-8547-24868223b005): created successfully
Apr 29 10:24:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1d21a0-bc4a-4a15-934e-84e7a0fc0049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Flow 'volume_create_manager' (1cbbba1f-a9e0-4a64-8e74-4d78d8cf2280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:24:47 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-728afbdd-3e53-424a-8896-09fe1a7c4fb9 tempest-GroupSnapshotsV319Test-151676271 None] Created volume successfully.
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Flow 'volume_create_manager' (05a97334-cd55-49da-b0e8-6ec850bc7b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07009d65-0ad8-4b3a-9784-3b9606c1d043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07009d65-0ad8-4b3a-9784-3b9606c1d043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-728935025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a7c6c8-4f0b-404f-9d9f-66928efa9207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc8265c7039d40c4ba62cea5d2290749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:24:48Z,use_quota=True,user_id='5998bbbec51342899f87377c102dce55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afd5ee5-25d4-4de9-9797-76a7f15f3438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afd5ee5-25d4-4de9-9797-76a7f15f3438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c982aa-414b-4e03-8688-722f59b1b457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c982aa-414b-4e03-8688-722f59b1b457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a7c6c8-4f0b-404f-9d9f-66928efa9207', 'volume_name': 'volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99427426-493b-4d68-a1b3-0f3a801dec68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99427426-493b-4d68-a1b3-0f3a801dec68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe07da7-c2b7-4580-ba1b-49a33427cb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:48 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Volume 69a7c6c8-4f0b-404f-9d9f-66928efa9207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207', 'volume_size': 1}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-728935025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a7c6c8-4f0b-404f-9d9f-66928efa9207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc8265c7039d40c4ba62cea5d2290749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:24:48Z,use_quota=True,user_id='5998bbbec51342899f87377c102dce55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Creating volume 69a7c6c8-4f0b-404f-9d9f-66928efa9207 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:24:48 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:48 devstack sudo[98568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207 1073741824
Apr 29 10:24:48 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:48 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] GroupSnapshot a0c3ec8a-3e79-4257-81ad-4fcb4a2f6877: creating.
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] Group snapshot a0c3ec8a-3e79-4257-81ad-4fcb4a2f6877: creating. {{(pid=84165) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 10:24:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7dfdb681-9e09-474e-9148-4a684780c6df tempest-VolumesActionsTest-1987562347 None] Acquiring lock "cinder-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" by "attach_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7dfdb681-9e09-474e-9148-4a684780c6df tempest-VolumesActionsTest-1987562347 None] Lock "cinder-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" acquired by "attach_volume" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:49 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-7dfdb681-9e09-474e-9148-4a684780c6df tempest-VolumesActionsTest-1987562347 None] Attaching volume 8dff1fe1-32dc-4e72-ad9d-f61db63ad86c to instance 81e1cb22-fa10-44f8-8cc6-6755949d6877 at mountpoint /dev/vdb on host None.
Apr 29 10:24:49 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-7dfdb681-9e09-474e-9148-4a684780c6df tempest-VolumesActionsTest-1987562347 None] Attach volume completed successfully.
Apr 29 10:24:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7dfdb681-9e09-474e-9148-4a684780c6df tempest-VolumesActionsTest-1987562347 None] Lock "cinder-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" released by "attach_volume" :: held 0.090s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:49 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207 1073741824" returned: 0 in 0.919s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:49 devstack sudo[98574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207
Apr 29 10:24:49 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3f38debc-1cc7-460f-b891-40a03b6ead73 tempest-VolumesActionsTest-1987562347 None] Acquiring lock "cinder-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c-detach_volume" by "detach_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3f38debc-1cc7-460f-b891-40a03b6ead73 tempest-VolumesActionsTest-1987562347 None] Lock "cinder-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:49 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3f38debc-1cc7-460f-b891-40a03b6ead73 tempest-VolumesActionsTest-1987562347 None] Detaching volume 8dff1fe1-32dc-4e72-ad9d-f61db63ad86c from instance 81e1cb22-fa10-44f8-8cc6-6755949d6877.
Apr 29 10:24:49 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3f38debc-1cc7-460f-b891-40a03b6ead73 tempest-VolumesActionsTest-1987562347 None] Detach volume completed successfully.
Apr 29 10:24:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3f38debc-1cc7-460f-b891-40a03b6ead73 tempest-VolumesActionsTest-1987562347 None] Lock "cinder-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:50 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207" returned: 0 in 0.618s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:50 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:24:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.243s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe07da7-c2b7-4580-ba1b-49a33427cb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ede9d0-4fde-492f-8119-f01749ac66d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:50 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] Creating offline snapshot a27a6491-7cdd-4716-8170-3a8d279ad905 of volume e3a5a8a4-a0fb-4993-8547-24868223b005 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:24:50 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Volume volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207 (69a7c6c8-4f0b-404f-9d9f-66928efa9207): created successfully
Apr 29 10:24:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ede9d0-4fde-492f-8119-f01749ac66d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Flow 'volume_create_manager' (05a97334-cd55-49da-b0e8-6ec850bc7b14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:24:50 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[824db2ee-f626-4eab-9948-e97c3976b830]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:24:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:50 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8c10d952-5026-495e-8a38-3f84279881f2 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Created volume successfully.
Apr 29 10:24:50 devstack sudo[98577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005
Apr 29 10:24:50 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:51 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005" returned: 0 in 0.855s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:51 devstack sudo[98582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905 1G
Apr 29 10:24:51 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Acquiring lock "cinder-69a7c6c8-4f0b-404f-9d9f-66928efa9207-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Lock "cinder-69a7c6c8-4f0b-404f-9d9f-66928efa9207-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Flow 'volume_create_manager' (23b72640-ccbf-448a-8818-539fe099f1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc9cc3e-9c2b-4350-985b-f9a3e35b809e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc9cc3e-9c2b-4350-985b-f9a3e35b809e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1412811034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9413df1-6b5c-41d7-affd-59a7c34eea31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b68ec8429437085fa78534eccc292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:24:52Z,use_quota=True,user_id='cfc733c400ef45e4a966257ba7b115e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354b6454-0c89-43a3-b2a3-8e1ee7e59143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354b6454-0c89-43a3-b2a3-8e1ee7e59143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f019f2a-baec-4847-9515-b431ce87fa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f019f2a-baec-4847-9515-b431ce87fa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9413df1-6b5c-41d7-affd-59a7c34eea31', 'volume_name': 'volume-e9413df1-6b5c-41d7-affd-59a7c34eea31', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcd74f9-6d9f-4379-b7b4-7d0e65001234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcd74f9-6d9f-4379-b7b4-7d0e65001234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797aa992-fd64-4f6e-9b0c-b23366299062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:52 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Volume e9413df1-6b5c-41d7-affd-59a7c34eea31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9413df1-6b5c-41d7-affd-59a7c34eea31', 'volume_size': 1}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Acquiring lock "cinder-quobyte-69a7c6c8-4f0b-404f-9d9f-66928efa9207" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Lock "cinder-quobyte-69a7c6c8-4f0b-404f-9d9f-66928efa9207" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adc3d10-a0c7-4823-a517-76d5f6d5a46c]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:52 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905 1G" returned: 0 in 1.229s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a5a8a4-a0fb-4993-8547-24868223b005 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:52 devstack sudo[98626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a5a8a4-a0fb-4993-8547-24868223b005 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905
Apr 29 10:24:52 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:52 devstack sudo[98625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207
Apr 29 10:24:52 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:53 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a5a8a4-a0fb-4993-8547-24868223b005 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905" returned: 0 in 0.741s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:53 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 10:24:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:53 devstack sudo[98637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905
Apr 29 10:24:53 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:53 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207" returned: 0 in 0.857s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:53 devstack sudo[98639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207
Apr 29 10:24:53 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:53 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905" returned: 0 in 0.670s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:53 devstack sudo[98644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.info
Apr 29 10:24:53 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:53 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-69a7c6c8-4f0b-404f-9d9f-66928efa9207" returned: 0 in 0.692s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Lock "cinder-quobyte-69a7c6c8-4f0b-404f-9d9f-66928efa9207" released by "delete_volume" :: held 1.597s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:53 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Created reservations ['6257e5e5-ac0a-4f97-8ad0-08e26787a53b', '99e7aef0-83e2-47f1-8c04-35069711fbd1', 'c663267f-2bb8-4a21-9c24-5eddb42fd28b', 'd0a61212-a5a3-46b7-9b0c-79d6b6ed66fd'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:24:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:24:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:24:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:54 devstack sudo[98646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:24:54 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:54 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.info" returned: 0 in 0.628s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:54 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 10:24:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:54 devstack sudo[98649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.info
Apr 29 10:24:54 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:54 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.617s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:54 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:24:54 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Deleted volume successfully.
Apr 29 10:24:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f07d776e-5197-4970-aa37-6768e254e6f4 tempest-VolumeQuotasNegativeTestJSON-1746385643 None] Lock "cinder-69a7c6c8-4f0b-404f-9d9f-66928efa9207-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:55 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.info" returned: 0 in 0.626s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.857s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.834s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1412811034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9413df1-6b5c-41d7-affd-59a7c34eea31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b68ec8429437085fa78534eccc292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:24:52Z,use_quota=True,user_id='cfc733c400ef45e4a966257ba7b115e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Creating volume e9413df1-6b5c-41d7-affd-59a7c34eea31 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:24:55 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9413df1-6b5c-41d7-affd-59a7c34eea31 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:55 devstack sudo[98653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9413df1-6b5c-41d7-affd-59a7c34eea31 1073741824
Apr 29 10:24:55 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:55 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5dbec6e7-3687-4341-b5c8-4d3d53d7a3b8 tempest-GroupSnapshotsV319Test-151676271 None] group_snapshot a0c3ec8a-3e79-4257-81ad-4fcb4a2f6877: created successfully
Apr 29 10:24:55 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] group_snapshot a0c3ec8a-3e79-4257-81ad-4fcb4a2f6877: deleting
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] group_snapshot a0c3ec8a-3e79-4257-81ad-4fcb4a2f6877: deleting {{(pid=84165) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] Acquiring lock "cinder-quobyte-e3a5a8a4-a0fb-4993-8547-24868223b005" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] Lock "cinder-quobyte-e3a5a8a4-a0fb-4993-8547-24868223b005" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] Acquiring lock "cinder-quobyte-a27a6491-7cdd-4716-8170-3a8d279ad905" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] Lock "cinder-quobyte-a27a6491-7cdd-4716-8170-3a8d279ad905" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] Deleting offline snapshot a27a6491-7cdd-4716-8170-3a8d279ad905 of volume e3a5a8a4-a0fb-4993-8547-24868223b005 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] snapshot_file for this snap is: volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[573d3900-cc42-49b0-bec4-8ebd9cc4faf6]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:24:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:56 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:56 devstack sudo[98659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905
Apr 29 10:24:56 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9413df1-6b5c-41d7-affd-59a7c34eea31 1073741824" returned: 0 in 0.970s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9413df1-6b5c-41d7-affd-59a7c34eea31 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:56 devstack sudo[98661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9413df1-6b5c-41d7-affd-59a7c34eea31
Apr 29 10:24:56 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:56 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9413df1-6b5c-41d7-affd-59a7c34eea31" returned: 0 in 0.675s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:24:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:24:56 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797aa992-fd64-4f6e-9b0c-b23366299062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9413df1-6b5c-41d7-affd-59a7c34eea31', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa6dd3f-81a6-4e5d-ab47-7d308e790bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:24:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905" returned: 0 in 0.927s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3a5a8a4-a0fb-4993-8547-24868223b005(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:24:56 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Volume volume-e9413df1-6b5c-41d7-affd-59a7c34eea31 (e9413df1-6b5c-41d7-affd-59a7c34eea31): created successfully
Apr 29 10:24:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa6dd3f-81a6-4e5d-ab47-7d308e790bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:24:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Flow 'volume_create_manager' (23b72640-ccbf-448a-8818-539fe099f1bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:24:56 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5c5ba4-6d4b-4616-833c-9700fe2a866c]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:24:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:56 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-93ea9476-d1c2-4026-878a-354a4b3a1d7f tempest-AttachVolumeShelveTestJSON-921790343 None] Created volume successfully.
Apr 29 10:24:56 devstack sudo[98668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005
Apr 29 10:24:56 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:57 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005" returned: 0 in 0.883s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:57 devstack sudo[98677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905
Apr 29 10:24:57 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:58 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905" returned: 0 in 0.894s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:24:58 devstack sudo[98684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905
Apr 29 10:24:58 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:24:59 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root
Apr 29 10:24:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005.a27a6491-7cdd-4716-8170-3a8d279ad905" returned: 0 in 0.719s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:24:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] Lock "cinder-quobyte-a27a6491-7cdd-4716-8170-3a8d279ad905" released by "_delete_snapshot" :: held 3.556s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] Lock "cinder-quobyte-e3a5a8a4-a0fb-4993-8547-24868223b005" released by "delete_snapshot" :: held 3.584s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:24:59 devstack cinder-volume[84165]: WARNING cinder.quota [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1950309604 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1950309604, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:24:59 devstack cinder-volume[84165]: WARNING cinder.quota [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1950309604 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1950309604, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:24:59 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] Created reservations ['3d8f73f7-c7b6-454e-abd0-1505e2b5b6a2', '8980d8ec-5205-40a2-9c53-43b60ec7ad7e', '0e31098c-6480-4eda-9283-c4a503cc04ce', 'c5224f31-848b-42a4-a67c-28f7e805b980'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:24:59 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-fc2e0e8f-7b46-497a-a868-fa66c35a618b tempest-GroupSnapshotsV319Test-151676271 None] group_snapshot a0c3ec8a-3e79-4257-81ad-4fcb4a2f6877: deleted successfully
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Flow 'volume_create_manager' (ec87287f-93b8-4a97-9e86-9567545af9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be828106-cb0d-4f48-8385-3939698bbd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be828106-cb0d-4f48-8385-3939698bbd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-363755845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de68f111-9dac-4ebe-93ca-542222270a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2cbcbc2701f49c688a819e8e0b5f1a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:25:00Z,use_quota=True,user_id='7e3e1fb3227848a3a651e624981d7edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91deac8e-cb37-4117-960e-c6c407eac9cc),volume_type_id=91deac8e-cb37-4117-960e-c6c407eac9cc)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbabe95-a53b-4b33-a9b3-f162d4952f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbabe95-a53b-4b33-a9b3-f162d4952f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02154f2-866a-4645-ad94-0aa647045d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02154f2-866a-4645-ad94-0aa647045d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de68f111-9dac-4ebe-93ca-542222270a1f', 'volume_name': 'volume-de68f111-9dac-4ebe-93ca-542222270a1f', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428e6a5a-8777-40b3-b68a-e3e000718c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428e6a5a-8777-40b3-b68a-e3e000718c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb636c9-0882-4614-b299-c245f0c5904b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:00 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Volume de68f111-9dac-4ebe-93ca-542222270a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de68f111-9dac-4ebe-93ca-542222270a1f', 'volume_size': 1}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-363755845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de68f111-9dac-4ebe-93ca-542222270a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2cbcbc2701f49c688a819e8e0b5f1a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:25:00Z,use_quota=True,user_id='7e3e1fb3227848a3a651e624981d7edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91deac8e-cb37-4117-960e-c6c407eac9cc),volume_type_id=91deac8e-cb37-4117-960e-c6c407eac9cc)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Creating volume de68f111-9dac-4ebe-93ca-542222270a1f {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:25:00 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-de68f111-9dac-4ebe-93ca-542222270a1f 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:00 devstack sudo[98801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-de68f111-9dac-4ebe-93ca-542222270a1f 1073741824
Apr 29 10:25:00 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Acquiring lock "cinder-quobyte-e3a5a8a4-a0fb-4993-8547-24868223b005" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Lock "cinder-quobyte-e3a5a8a4-a0fb-4993-8547-24868223b005" acquired by "delete_volume" :: waited 0.026s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbd7017-e569-451b-951d-1987892e8309]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:25:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:00 devstack sudo[98852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005
Apr 29 10:25:00 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:01 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-de68f111-9dac-4ebe-93ca-542222270a1f 1073741824" returned: 0 in 1.006s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-de68f111-9dac-4ebe-93ca-542222270a1f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:01 devstack sudo[99067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-de68f111-9dac-4ebe-93ca-542222270a1f
Apr 29 10:25:01 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:01 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005" returned: 0 in 0.958s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:01 devstack sudo[99069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005
Apr 29 10:25:01 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:02 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-de68f111-9dac-4ebe-93ca-542222270a1f" returned: 0 in 0.673s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb636c9-0882-4614-b299-c245f0c5904b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de68f111-9dac-4ebe-93ca-542222270a1f', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c639d9c0-3a7e-400f-b4aa-1932f8d36172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:02 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Volume volume-de68f111-9dac-4ebe-93ca-542222270a1f (de68f111-9dac-4ebe-93ca-542222270a1f): created successfully
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c639d9c0-3a7e-400f-b4aa-1932f8d36172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Flow 'volume_create_manager' (ec87287f-93b8-4a97-9e86-9567545af9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:25:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-6f1cca65-ebc8-4cd0-b3e1-4a14838390d3 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Created volume successfully.
Apr 29 10:25:02 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e3a5a8a4-a0fb-4993-8547-24868223b005" returned: 0 in 0.679s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Lock "cinder-quobyte-e3a5a8a4-a0fb-4993-8547-24868223b005" released by "delete_volume" :: held 1.713s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Created reservations ['abd42804-b3ba-456a-b6f2-fc43e664e5fe'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:25:02 devstack cinder-volume[84165]: WARNING cinder.quota [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1950309604 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1950309604, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Created reservations ['458ada4f-063c-4ca2-ae31-69c7eac1641d', '70eac379-ac28-4ded-a9e2-5701ccef23a7', '2a9b2d6a-787d-42db-9917-1234f6451d0a', '84384bba-ea23-454d-8023-5dc9de757a61'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:25:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:02 devstack sudo[99080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:25:02 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e019ec46-06f5-46cb-a690-4d857a20b487 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e019ec46-06f5-46cb-a690-4d857a20b487 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:25:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e019ec46-06f5-46cb-a690-4d857a20b487 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:25:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e019ec46-06f5-46cb-a690-4d857a20b487 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:25:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e019ec46-06f5-46cb-a690-4d857a20b487 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:25:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e019ec46-06f5-46cb-a690-4d857a20b487 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:03 devstack sudo[99087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:25:03 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:03 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.023s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:03 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:25:03 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-bfe22295-c66a-43cc-9244-9a1886506d58 tempest-GroupSnapshotsV319Test-151676271 None] Delete group completed successfully.
Apr 29 10:25:03 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e019ec46-06f5-46cb-a690-4d857a20b487 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.957s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:03 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e019ec46-06f5-46cb-a690-4d857a20b487 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:25:04 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e019ec46-06f5-46cb-a690-4d857a20b487 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Retype volume completed successfully.
Apr 29 10:25:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Acquiring lock "cinder-de68f111-9dac-4ebe-93ca-542222270a1f-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:25:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Lock "cinder-de68f111-9dac-4ebe-93ca-542222270a1f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:25:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Acquiring lock "cinder-quobyte-de68f111-9dac-4ebe-93ca-542222270a1f" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:25:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Lock "cinder-quobyte-de68f111-9dac-4ebe-93ca-542222270a1f" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:25:04 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b24fbfb-6d65-41b0-ab5a-e78064fab673]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:25:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-de68f111-9dac-4ebe-93ca-542222270a1f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:04 devstack sudo[99091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-de68f111-9dac-4ebe-93ca-542222270a1f
Apr 29 10:25:04 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:25:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:25:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:25:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:25:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:25:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:05 devstack sudo[99108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:25:05 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:05 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-de68f111-9dac-4ebe-93ca-542222270a1f" returned: 0 in 1.078s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-de68f111-9dac-4ebe-93ca-542222270a1f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:05 devstack sudo[99114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-de68f111-9dac-4ebe-93ca-542222270a1f
Apr 29 10:25:05 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:06 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.975s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:25:06 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-de68f111-9dac-4ebe-93ca-542222270a1f" returned: 0 in 0.904s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Lock "cinder-quobyte-de68f111-9dac-4ebe-93ca-542222270a1f" released by "delete_volume" :: held 2.042s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:25:06 devstack cinder-volume[84165]: WARNING cinder.quota [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:25:06 devstack cinder-volume[84165]: WARNING cinder.quota [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:25:06 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Created reservations ['676df819-c6f3-4fc8-b89b-1fc590d06ba3', 'd8f3d867-9847-49ba-b003-e8aabbd87903', '93c018d8-1056-4bd7-821f-7fe617ce34e5', 'cafa92dc-c3bd-47b2-a22a-fa01970ac198'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:25:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:25:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:25:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:25:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:25:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:06 devstack sudo[99118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:25:06 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:07 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.903s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:07 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:25:07 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Deleted volume successfully.
Apr 29 10:25:07 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9a0bd5c2-5e97-4c36-b756-78ad9ef73c77 tempest-VolumeRetypeWithoutMigrationTest-654380306 None] Lock "cinder-de68f111-9dac-4ebe-93ca-542222270a1f-delete_volume" released by "delete_volume" :: held 3.291s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:25:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3bdcfd2b-ea48-4c3a-b57c-b942861eae1a tempest-VolumesActionsTest-1987562347 None] Acquiring lock "cinder-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" by "attach_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:25:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3bdcfd2b-ea48-4c3a-b57c-b942861eae1a tempest-VolumesActionsTest-1987562347 None] Lock "cinder-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" acquired by "attach_volume" :: waited 0.040s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:25:14 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3bdcfd2b-ea48-4c3a-b57c-b942861eae1a tempest-VolumesActionsTest-1987562347 None] Attaching volume 8dff1fe1-32dc-4e72-ad9d-f61db63ad86c to instance a01b3cae-9862-4467-91b1-f6e1231e5517 at mountpoint /dev/vdb on host None.
Apr 29 10:25:14 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3bdcfd2b-ea48-4c3a-b57c-b942861eae1a tempest-VolumesActionsTest-1987562347 None] Attach volume completed successfully.
Apr 29 10:25:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3bdcfd2b-ea48-4c3a-b57c-b942861eae1a tempest-VolumesActionsTest-1987562347 None] Lock "cinder-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" released by "attach_volume" :: held 0.229s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:25:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a07336d8-3f6e-44d0-af94-0dbcc2b024f5 tempest-VolumesActionsTest-1987562347 None] Acquiring lock "cinder-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c-detach_volume" by "detach_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:25:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a07336d8-3f6e-44d0-af94-0dbcc2b024f5 tempest-VolumesActionsTest-1987562347 None] Lock "cinder-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:25:15 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a07336d8-3f6e-44d0-af94-0dbcc2b024f5 tempest-VolumesActionsTest-1987562347 None] Detaching volume 8dff1fe1-32dc-4e72-ad9d-f61db63ad86c from instance a01b3cae-9862-4467-91b1-f6e1231e5517.
Apr 29 10:25:15 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a07336d8-3f6e-44d0-af94-0dbcc2b024f5 tempest-VolumesActionsTest-1987562347 None] Detach volume completed successfully.
Apr 29 10:25:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a07336d8-3f6e-44d0-af94-0dbcc2b024f5 tempest-VolumesActionsTest-1987562347 None] Lock "cinder-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Flow 'volume_create_manager' (2f119bd9-8b8d-4a25-aae4-2c3183cf3467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d609b0-dcf3-4e48-bde9-85ae9c12b4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d609b0-dcf3-4e48-bde9-85ae9c12b4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1230200328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e4cbcb-e953-437e-87b0-20c9468fe750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad19e1d337f427fa96f961860ee0937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:25:16Z,use_quota=True,user_id='4a6c1177185d4bfea53f190fea13223c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfefb26-73da-4729-9c17-b378fa2c6872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfefb26-73da-4729-9c17-b378fa2c6872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a58e81-b81c-4916-950c-69d674195eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a58e81-b81c-4916-950c-69d674195eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e4cbcb-e953-437e-87b0-20c9468fe750', 'volume_name': 'volume-a4e4cbcb-e953-437e-87b0-20c9468fe750', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b8ad32-e9fd-4ad6-9b9e-9359b2926363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b8ad32-e9fd-4ad6-9b9e-9359b2926363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606f9152-874c-4d01-8a55-7e371e1affe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:16 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Volume a4e4cbcb-e953-437e-87b0-20c9468fe750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e4cbcb-e953-437e-87b0-20c9468fe750', 'volume_size': 1}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1230200328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e4cbcb-e953-437e-87b0-20c9468fe750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad19e1d337f427fa96f961860ee0937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:25:16Z,use_quota=True,user_id='4a6c1177185d4bfea53f190fea13223c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Creating volume a4e4cbcb-e953-437e-87b0-20c9468fe750 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:25:16 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:16 devstack sudo[99312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750 1073741824
Apr 29 10:25:16 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-166d7df0-2046-465a-85d9-ef47eb30a234 req-9f843fc2-a2fa-4532-8053-cadb80df8ce8 tempest-AttachVolumeShelveTestJSON-921790343 None] No connector for attachment f298ff9b-61c2-4c94-bdea-bfe6c606505d; skipping storage backend terminate_connection call. {{(pid=84165) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Apr 29 10:25:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-166d7df0-2046-465a-85d9-ef47eb30a234 req-9f843fc2-a2fa-4532-8053-cadb80df8ce8 tempest-AttachVolumeShelveTestJSON-921790343 None] Deleting attachment f298ff9b-61c2-4c94-bdea-bfe6c606505d. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:25:17 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750 1073741824" returned: 0 in 1.274s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:17 devstack sudo[99383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750
Apr 29 10:25:17 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:18 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750" returned: 0 in 1.104s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] <== create_volume: return (2468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:25:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.471s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:25:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606f9152-874c-4d01-8a55-7e371e1affe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e4cbcb-e953-437e-87b0-20c9468fe750', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e254eff4-2a68-45de-a68a-7e700eacd809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:18 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Volume volume-a4e4cbcb-e953-437e-87b0-20c9468fe750 (a4e4cbcb-e953-437e-87b0-20c9468fe750): created successfully
Apr 29 10:25:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e254eff4-2a68-45de-a68a-7e700eacd809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Flow 'volume_create_manager' (2f119bd9-8b8d-4a25-aae4-2c3183cf3467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:25:18 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-7eedbd65-237b-4634-8ce5-0e281162a23c tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Created volume successfully.
Apr 29 10:25:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:25:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Creating offline snapshot 3d44655b-1127-41f4-a2d8-14db1fcf19b7 of volume a4e4cbcb-e953-437e-87b0-20c9468fe750 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:25:19 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a37b565-df2e-425f-b35f-b9eb3822e8f4]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:25:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:20 devstack sudo[99406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750
Apr 29 10:25:20 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:20 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750" returned: 0 in 0.719s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:20 devstack sudo[99417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7 1G
Apr 29 10:25:20 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:21 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7 1G" returned: 0 in 0.858s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4e4cbcb-e953-437e-87b0-20c9468fe750 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:21 devstack sudo[99423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4e4cbcb-e953-437e-87b0-20c9468fe750 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7
Apr 29 10:25:21 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:22 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4e4cbcb-e953-437e-87b0-20c9468fe750 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7" returned: 0 in 0.731s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:22 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7 is being set with open permissions: ugo+rw
Apr 29 10:25:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:22 devstack sudo[99428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7
Apr 29 10:25:22 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:22 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7" returned: 0 in 0.618s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:22 devstack sudo[99431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.info
Apr 29 10:25:22 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:23 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.info" returned: 0 in 0.640s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:23 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.info is being set with open permissions: ugo+rw
Apr 29 10:25:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:23 devstack sudo[99435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.info
Apr 29 10:25:23 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:24 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.info" returned: 0 in 0.626s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.288s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:25:24 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=90,cinder:UPDATE=90,cinder:INSERT=21,cinder:DELETE=5 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:25:24 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8d8521bf-4899-45a2-969e-de722fc18305 tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Create snapshot completed successfully
Apr 29 10:25:24 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-cda9bd97-754c-4017-9f00-0ed25752c4b3 tempest-GroupsTest-925188494 None] Group tempest-Group1-1987306746: creating
Apr 29 10:25:24 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-cda9bd97-754c-4017-9f00-0ed25752c4b3 tempest-GroupsTest-925188494 None] Group tempest-Group1-1987306746: created successfully
Apr 29 10:25:24 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-cda9bd97-754c-4017-9f00-0ed25752c4b3 tempest-GroupsTest-925188494 None] Create group completed successfully.
Apr 29 10:25:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Acquiring lock "cinder-3d44655b-1127-41f4-a2d8-14db1fcf19b7-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:25:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "cinder-3d44655b-1127-41f4-a2d8-14db1fcf19b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:25:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Acquiring lock "cinder-quobyte-a4e4cbcb-e953-437e-87b0-20c9468fe750" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:25:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "cinder-quobyte-a4e4cbcb-e953-437e-87b0-20c9468fe750" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:25:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Acquiring lock "cinder-quobyte-3d44655b-1127-41f4-a2d8-14db1fcf19b7" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:25:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "cinder-quobyte-3d44655b-1127-41f4-a2d8-14db1fcf19b7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:25:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Deleting offline snapshot 3d44655b-1127-41f4-a2d8-14db1fcf19b7 of volume a4e4cbcb-e953-437e-87b0-20c9468fe750 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:25:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] snapshot_file for this snap is: volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:25:25 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28bf017-1afb-4daa-9a85-ab09cf178c22]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:25:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:25 devstack sudo[99439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7
Apr 29 10:25:25 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:25 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-97ebb7b0-24be-4216-99af-03da92913b10 tempest-GroupsTest-925188494 None] Group tempest-Group2-1709180458: creating
Apr 29 10:25:25 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-97ebb7b0-24be-4216-99af-03da92913b10 tempest-GroupsTest-925188494 None] Group tempest-Group2-1709180458: created successfully
Apr 29 10:25:25 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-97ebb7b0-24be-4216-99af-03da92913b10 tempest-GroupsTest-925188494 None] Create group completed successfully.
Apr 29 10:25:26 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7" returned: 0 in 0.874s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:26 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4e4cbcb-e953-437e-87b0-20c9468fe750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:25:26 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[674055e0-ec50-4e88-af5c-04db99b21490]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:25:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:26 devstack sudo[99444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750
Apr 29 10:25:26 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:27 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750" returned: 0 in 0.729s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:27 devstack sudo[99452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7
Apr 29 10:25:27 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Flow 'volume_create_manager' (8a42ee00-bd58-491f-a770-ba92030b09de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16e02a0-d730-450c-8b6f-2c49ea55b58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16e02a0-d730-450c-8b6f-2c49ea55b58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117333363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=62c343d5-0fc8-4b41-8d04-6f5bf6898467,host='devstack@QuobyteHD#QuobyteHD',id=0f149306-305f-4a1a-89a4-cb0a6aada8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c164af154d94d15b2d83fd0a6c1f9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:25:28Z,use_quota=True,user_id='ac7b88178c044f37b2078296e9b15074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abd90966-d8ed-420b-87eb-67724f93ae2d),volume_type_id=abd90966-d8ed-420b-87eb-67724f93ae2d)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2807501e-cd2f-4429-8e11-8329072b4c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2807501e-cd2f-4429-8e11-8329072b4c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a483035b-bed1-49dc-b210-422f251f64dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a483035b-bed1-49dc-b210-422f251f64dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f149306-305f-4a1a-89a4-cb0a6aada8bd', 'volume_name': 'volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20842400-6eb1-428c-9aa5-65361f6faa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20842400-6eb1-428c-9aa5-65361f6faa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253b3a41-ff47-45ee-84fd-1f504d9a7132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:27 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Volume 0f149306-305f-4a1a-89a4-cb0a6aada8bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd', 'volume_size': 1}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=62c343d5-0fc8-4b41-8d04-6f5bf6898467,created_at=2026-04-29T08:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117333363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=62c343d5-0fc8-4b41-8d04-6f5bf6898467,host='devstack@QuobyteHD#QuobyteHD',id=0f149306-305f-4a1a-89a4-cb0a6aada8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c164af154d94d15b2d83fd0a6c1f9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:25:28Z,use_quota=True,user_id='ac7b88178c044f37b2078296e9b15074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abd90966-d8ed-420b-87eb-67724f93ae2d),volume_type_id=abd90966-d8ed-420b-87eb-67724f93ae2d)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Creating volume 0f149306-305f-4a1a-89a4-cb0a6aada8bd {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:25:27 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:25:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:27 devstack sudo[99454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd 1073741824
Apr 29 10:25:27 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:28 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7" returned: 0 in 0.830s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:28 devstack sudo[99459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7
Apr 29 10:25:28 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:28 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd 1073741824" returned: 0 in 0.851s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:28 devstack sudo[99466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd
Apr 29 10:25:28 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:28 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750.3d44655b-1127-41f4-a2d8-14db1fcf19b7" returned: 0 in 0.838s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "cinder-quobyte-3d44655b-1127-41f4-a2d8-14db1fcf19b7" released by "_delete_snapshot" :: held 3.420s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:25:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "cinder-quobyte-a4e4cbcb-e953-437e-87b0-20c9468fe750" released by "delete_snapshot" :: held 3.446s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:25:29 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Created reservations ['20a3855e-e2f3-4fe9-8530-9e60bbd3fb40', 'af4be5dc-64dd-477c-bb88-3e0669da717f', 'a29a6ed8-d7f9-4e15-86a9-50e1d4287c65', '0971c589-709a-4867-b93f-44da7b230ced'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:25:29 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Delete snapshot completed successfully.
Apr 29 10:25:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-97ebc776-8a72-4dc8-9379-b090f73a0adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "cinder-3d44655b-1127-41f4-a2d8-14db1fcf19b7-delete_snapshot" released by "delete_snapshot" :: held 3.646s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:25:29 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd" returned: 0 in 0.880s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:25:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:25:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253b3a41-ff47-45ee-84fd-1f504d9a7132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a72a35f-b4cb-431f-92c9-a347942e63e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:29 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Volume volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd (0f149306-305f-4a1a-89a4-cb0a6aada8bd): created successfully
Apr 29 10:25:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a72a35f-b4cb-431f-92c9-a347942e63e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Flow 'volume_create_manager' (8a42ee00-bd58-491f-a770-ba92030b09de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:25:29 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e6e20aa4-132b-4cf7-9e65-504490f8cd91 tempest-GroupsTest-925188494 None] Created volume successfully.
Apr 29 10:25:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Acquiring lock "cinder-a4e4cbcb-e953-437e-87b0-20c9468fe750-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:25:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "cinder-a4e4cbcb-e953-437e-87b0-20c9468fe750-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:25:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Acquiring lock "cinder-quobyte-a4e4cbcb-e953-437e-87b0-20c9468fe750" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:25:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "cinder-quobyte-a4e4cbcb-e953-437e-87b0-20c9468fe750" acquired by "delete_volume" :: waited 0.028s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:25:30 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a3e98c-5962-414b-a3c3-9be1f438c59c]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:25:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:25:30 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bba9b91-d181-4c56-b4ea-ae383717f6a5]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:25:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:30 devstack sudo[99469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750
Apr 29 10:25:30 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:30 devstack sudo[99470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c
Apr 29 10:25:30 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Acquiring lock "cinder-quobyte-0f149306-305f-4a1a-89a4-cb0a6aada8bd" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:25:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Lock "cinder-quobyte-0f149306-305f-4a1a-89a4-cb0a6aada8bd" acquired by "delete_volume" :: waited 0.039s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:25:30 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[03731451-c731-43c1-9a4f-b6d5ee9b1ac3]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:25:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:30 devstack sudo[99483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd
Apr 29 10:25:30 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:30 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750" returned: 0 in 0.896s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:30 devstack sudo[99488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750
Apr 29 10:25:30 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:31 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" returned: 0 in 1.056s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:31 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ee2bfe-0289-4d50-bc58-b3f979e6bc94]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:25:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:31 devstack sudo[99500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c
Apr 29 10:25:31 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:31 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd" returned: 0 in 0.851s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:31 devstack sudo[99516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd
Apr 29 10:25:31 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:31 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a4e4cbcb-e953-437e-87b0-20c9468fe750" returned: 0 in 0.707s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "cinder-quobyte-a4e4cbcb-e953-437e-87b0-20c9468fe750" released by "delete_volume" :: held 1.711s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:25:31 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Created reservations ['0a0d8d5d-96f9-498b-8676-4a9f38a575b5', 'e90ca640-47f6-4340-afff-167e3ec9a523', '26d424bd-066e-4a9b-81c8-7f7f44d19c52', '0551e0cc-361e-453b-9cc9-c7f3fe6402ea'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:25:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:25:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:25:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:25:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:25:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:31 devstack sudo[99518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:25:31 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:32 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" returned: 0 in 0.794s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.a5ccacff-1b86-462c-9556-dc4434d02103y2sx4_bj.img {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:32 devstack sudo[99523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.a5ccacff-1b86-462c-9556-dc4434d02103y2sx4_bj.img
Apr 29 10:25:32 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:32 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0f149306-305f-4a1a-89a4-cb0a6aada8bd" returned: 0 in 0.737s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Lock "cinder-quobyte-0f149306-305f-4a1a-89a4-cb0a6aada8bd" released by "delete_volume" :: held 1.659s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:25:32 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Created reservations ['b85641e6-c042-4ccd-a708-8e9d6d2df132'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:25:32 devstack cinder-volume[84165]: WARNING cinder.quota [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1459396553 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1459396553, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:25:32 devstack cinder-volume[84165]: WARNING cinder.quota [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1459396553 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1459396553, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:25:32 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Created reservations ['3659000c-7b0f-4523-8f5b-b8c74cb2f009', 'b0c0b34f-1ee9-4a71-acdf-4ec9bff41658', 'edeee8c3-6e89-4610-aab5-aaf30e6e319f', 'cac78c1c-421f-4074-929e-a1bc6292f69b'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:25:32 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.746s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:32 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:25:32 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Deleted volume successfully.
Apr 29 10:25:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7afc0681-4b93-4a92-9999-295534fc99ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1350976927 None] Lock "cinder-a4e4cbcb-e953-437e-87b0-20c9468fe750-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:25:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:25:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:25:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:25:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:25:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:32 devstack sudo[99536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:25:32 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:33 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-d013998e-6ba1-40c1-a5e4-183c91548d94 tempest-GroupsTest-925188494 None] Created reservations ['d39085c1-e29b-4cf5-a758-589275e09321'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:25:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d013998e-6ba1-40c1-a5e4-183c91548d94 tempest-GroupsTest-925188494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d013998e-6ba1-40c1-a5e4-183c91548d94 tempest-GroupsTest-925188494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:25:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d013998e-6ba1-40c1-a5e4-183c91548d94 tempest-GroupsTest-925188494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:25:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d013998e-6ba1-40c1-a5e4-183c91548d94 tempest-GroupsTest-925188494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:25:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d013998e-6ba1-40c1-a5e4-183c91548d94 tempest-GroupsTest-925188494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:25:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d013998e-6ba1-40c1-a5e4-183c91548d94 tempest-GroupsTest-925188494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:34 devstack sudo[99549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:25:34 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:34 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.399s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:34 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:25:34 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a920ebec-6494-4425-bcff-14950ae94ec4 tempest-GroupsTest-925188494 None] Delete group completed successfully.
Apr 29 10:25:35 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d013998e-6ba1-40c1-a5e4-183c91548d94 tempest-GroupsTest-925188494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.950s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:35 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-d013998e-6ba1-40c1-a5e4-183c91548d94 tempest-GroupsTest-925188494 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:25:35 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d013998e-6ba1-40c1-a5e4-183c91548d94 tempest-GroupsTest-925188494 None] Delete group completed successfully.
Apr 29 10:25:36 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a23c8eb0-4f96-41f5-acc2-008d7c40fb6f tempest-GroupsTest-925188494 None] Group tempest-GroupsTest-Group-1806468230: creating
Apr 29 10:25:36 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a23c8eb0-4f96-41f5-acc2-008d7c40fb6f tempest-GroupsTest-925188494 None] Group tempest-GroupsTest-Group-1806468230: created successfully
Apr 29 10:25:36 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a23c8eb0-4f96-41f5-acc2-008d7c40fb6f tempest-GroupsTest-925188494 None] Create group completed successfully.
Apr 29 10:25:38 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:25:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Flow 'volume_create_manager' (9c8a7204-7968-4fcd-b23b-51d9a916b986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:25:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011cc2dd-f87b-48ad-8ac9-ef9575d99853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011cc2dd-f87b-48ad-8ac9-ef9575d99853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1585464751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b2995ea0-8008-494c-a80f-ac7149daaa85,host='devstack@QuobyteHD#QuobyteHD',id=ca5ab8c8-d725-4561-a263-377fdbfd961a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c164af154d94d15b2d83fd0a6c1f9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:25:39Z,use_quota=True,user_id='ac7b88178c044f37b2078296e9b15074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7a28933-f319-4808-80d7-75b6f1ab653b),volume_type_id=d7a28933-f319-4808-80d7-75b6f1ab653b)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:39 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f05982c-5708-4061-9980-4eba9edc8707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f05982c-5708-4061-9980-4eba9edc8707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de32eb77-bd2c-4fd6-8e2e-8ba862904127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de32eb77-bd2c-4fd6-8e2e-8ba862904127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca5ab8c8-d725-4561-a263-377fdbfd961a', 'volume_name': 'volume-ca5ab8c8-d725-4561-a263-377fdbfd961a', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7047a89-23ad-4ee4-af0c-cf4b55eab7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7047a89-23ad-4ee4-af0c-cf4b55eab7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d58fd03-0a64-40f6-9fcd-0904cb697de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:39 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Volume ca5ab8c8-d725-4561-a263-377fdbfd961a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca5ab8c8-d725-4561-a263-377fdbfd961a', 'volume_size': 1}
Apr 29 10:25:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.a5ccacff-1b86-462c-9556-dc4434d02103y2sx4_bj.img" returned: 0 in 7.012s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:39 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6fa9b4-dac6-4d79-8875-867a965eeeec]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:25:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:25:39 devstack sudo[99557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c
Apr 29 10:25:39 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:25:40 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root
Apr 29 10:25:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" returned: 0 in 1.252s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:25:40 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.a5ccacff-1b86-462c-9556-dc4434d02103y2sx4_bj.img {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:25:40 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] Converted 1024.00 MB image at 146.01 MB/s
Apr 29 10:25:40 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=107,cinder:INSERT=25,cinder:UPDATE=95,cinder:DELETE=6 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:25:40 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] a5ccacff-1b86-462c-9556-dc4434d02103 was raw, no need to convert to raw {{(pid=84165) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 29 10:25:44 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:25:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Flow 'volume_create_manager' (6b82e95f-7b41-4ddc-853b-b8dec4561a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:25:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57daaa1a-2cee-4a1c-be43-78880a8408b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57daaa1a-2cee-4a1c-be43-78880a8408b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1779010545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f0429d-4fc6-4c55-8900-ae90b5262c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0415d6a57b04293ac3673766edeacef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:25:44Z,use_quota=True,user_id='7cb0a801d4724f9dbcf25502f1960a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8186a6c-90d6-4c1f-8f85-64a7d8c19dcb),volume_type_id=b8186a6c-90d6-4c1f-8f85-64a7d8c19dcb)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336d745c-62ec-4fe9-955a-ddac411b8f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336d745c-62ec-4fe9-955a-ddac411b8f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d1954f-363a-4190-bd47-fdefa45bed59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d1954f-363a-4190-bd47-fdefa45bed59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f0429d-4fc6-4c55-8900-ae90b5262c8f', 'volume_name': 'volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2a74a5-80be-4b29-94ea-58ef9472778f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2a74a5-80be-4b29-94ea-58ef9472778f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:25:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a27cc838-931c-4f06-bdbe-03b14d1f6676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:25:44 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Volume a0f0429d-4fc6-4c55-8900-ae90b5262c8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f', 'volume_size': 1}
Apr 29 10:25:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:25:54 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=39,cinder:SELECT=32,cinder:INSERT=5,cinder:DELETE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:25:54 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:26:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.897s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] Uploaded volume to glance image-id: a5ccacff-1b86-462c-9556-dc4434d02103. {{(pid=84165) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 29 10:26:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.997s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b2995ea0-8008-494c-a80f-ac7149daaa85,created_at=2026-04-29T08:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1585464751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b2995ea0-8008-494c-a80f-ac7149daaa85,host='devstack@QuobyteHD#QuobyteHD',id=ca5ab8c8-d725-4561-a263-377fdbfd961a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c164af154d94d15b2d83fd0a6c1f9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:25:39Z,use_quota=True,user_id='ac7b88178c044f37b2078296e9b15074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7a28933-f319-4808-80d7-75b6f1ab653b),volume_type_id=d7a28933-f319-4808-80d7-75b6f1ab653b)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:26:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Creating volume ca5ab8c8-d725-4561-a263-377fdbfd961a {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:26:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:26:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:26:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:26:01 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:26:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ca5ab8c8-d725-4561-a263-377fdbfd961a 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:01 devstack sudo[99642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ca5ab8c8-d725-4561-a263-377fdbfd961a 1073741824
Apr 29 10:26:01 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-32cc82fe-f0cd-4a5c-acb9-c1adbe8e1f49 tempest-VolumesActionsTest-1987562347 None] Copy volume to image completed successfully.
Apr 29 10:26:01 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:01 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ca5ab8c8-d725-4561-a263-377fdbfd961a 1073741824" returned: 0 in 0.872s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ca5ab8c8-d725-4561-a263-377fdbfd961a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:02 devstack sudo[99648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ca5ab8c8-d725-4561-a263-377fdbfd961a
Apr 29 10:26:02 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:02 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ca5ab8c8-d725-4561-a263-377fdbfd961a" returned: 0 in 0.602s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.463s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1779010545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f0429d-4fc6-4c55-8900-ae90b5262c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0415d6a57b04293ac3673766edeacef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:25:44Z,use_quota=True,user_id='7cb0a801d4724f9dbcf25502f1960a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8186a6c-90d6-4c1f-8f85-64a7d8c19dcb),volume_type_id=b8186a6c-90d6-4c1f-8f85-64a7d8c19dcb)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Creating volume a0f0429d-4fc6-4c55-8900-ae90b5262c8f {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:26:02 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:02 devstack sudo[99651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f 1073741824
Apr 29 10:26:02 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d58fd03-0a64-40f6-9fcd-0904cb697de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca5ab8c8-d725-4561-a263-377fdbfd961a', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e0260b-4a4f-43ad-b874-28f63e26fac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:02 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Volume volume-ca5ab8c8-d725-4561-a263-377fdbfd961a (ca5ab8c8-d725-4561-a263-377fdbfd961a): created successfully
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e0260b-4a4f-43ad-b874-28f63e26fac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Flow 'volume_create_manager' (9c8a7204-7968-4fcd-b23b-51d9a916b986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:26:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-542b40ea-5bab-4510-84b6-1a7130b8af6f tempest-GroupsTest-925188494 None] Created volume successfully.
Apr 29 10:26:03 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f 1073741824" returned: 0 in 0.840s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:03 devstack sudo[99661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f
Apr 29 10:26:03 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Flow 'volume_create_manager' (7c213363-3040-4ac6-8c62-34a4b5b6e0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347a6d64-d427-4228-84c1-188a6cc70bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347a6d64-d427-4228-84c1-188a6cc70bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-505823417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b2995ea0-8008-494c-a80f-ac7149daaa85,host='devstack@QuobyteHD#QuobyteHD',id=88facf99-4f5c-436f-ae14-0fa8db3bfbaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c164af154d94d15b2d83fd0a6c1f9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:26:04Z,use_quota=True,user_id='ac7b88178c044f37b2078296e9b15074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7a28933-f319-4808-80d7-75b6f1ab653b),volume_type_id=d7a28933-f319-4808-80d7-75b6f1ab653b)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881e4f77-b6c6-4589-80d0-594f5009472a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881e4f77-b6c6-4589-80d0-594f5009472a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4a9108-3e43-42a8-9b55-713b02fe7309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4a9108-3e43-42a8-9b55-713b02fe7309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88facf99-4f5c-436f-ae14-0fa8db3bfbaa', 'volume_name': 'volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae30bb2b-5343-45db-b2eb-a7d9d4506067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae30bb2b-5343-45db-b2eb-a7d9d4506067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c658f210-eb6f-4167-a945-88173e488b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:04 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Volume 88facf99-4f5c-436f-ae14-0fa8db3bfbaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa', 'volume_size': 1}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:04 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f" returned: 0 in 0.658s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.485s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6729f0-1b09-40cb-8574-8e58d8e9d532]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a27cc838-931c-4f06-bdbe-03b14d1f6676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cbef2e8-96c5-452b-981b-83b049fbeadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:04 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Volume volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f (a0f0429d-4fc6-4c55-8900-ae90b5262c8f): created successfully
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cbef2e8-96c5-452b-981b-83b049fbeadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Flow 'volume_create_manager' (6b82e95f-7b41-4ddc-853b-b8dec4561a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:26:04 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0a1db2b9-d4bd-4d8b-9341-e20439e4ddc7 tempest-VolumeTypesAccessTest-1829881622 None] Created volume successfully.
Apr 29 10:26:04 devstack sudo[99664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c
Apr 29 10:26:04 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Acquiring lock "cinder-a0f0429d-4fc6-4c55-8900-ae90b5262c8f-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Lock "cinder-a0f0429d-4fc6-4c55-8900-ae90b5262c8f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Acquiring lock "cinder-quobyte-a0f0429d-4fc6-4c55-8900-ae90b5262c8f" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Lock "cinder-quobyte-a0f0429d-4fc6-4c55-8900-ae90b5262c8f" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0270b58d-1853-4912-bba5-841304f1a68d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:05 devstack sudo[99706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f
Apr 29 10:26:05 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:05 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" returned: 0 in 0.942s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:05 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f312db-5bcb-48b2-b8f8-ae84a1b9a392]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:05 devstack sudo[99709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c
Apr 29 10:26:05 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:26:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:26:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:26:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:05 devstack sudo[99711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:26:05 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:05 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f" returned: 0 in 0.803s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:05 devstack sudo[99718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f
Apr 29 10:26:05 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:05 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" returned: 0 in 0.835s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.6b7a6795-45be-4009-a2e2-a6431148a9f442l74vxm.img {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:06 devstack sudo[99723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.6b7a6795-45be-4009-a2e2-a6431148a9f442l74vxm.img
Apr 29 10:26:06 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:06 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.683s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:26:06 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a0f0429d-4fc6-4c55-8900-ae90b5262c8f" returned: 0 in 0.734s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Lock "cinder-quobyte-a0f0429d-4fc6-4c55-8900-ae90b5262c8f" released by "delete_volume" :: held 1.580s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:26:06 devstack cinder-volume[84165]: WARNING cinder.quota [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-985598750 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-985598750, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:26:06 devstack cinder-volume[84165]: WARNING cinder.quota [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-985598750 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-985598750, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:26:07 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Created reservations ['bb717e35-4857-42f4-bab6-dd5d0d7aea5a', 'e5467859-6dcc-4e68-a5f8-d00c0fe4b396', 'd5c4dead-86c6-43b3-a5c6-bb66061f8545', '3fea6fce-faf1-4a03-baea-03a9b172cdef'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:26:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:26:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:26:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:09 devstack sudo[99738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:26:09 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:10 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.510s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:10 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:26:10 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Deleted volume successfully.
Apr 29 10:26:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a10b7c3d-9435-4653-9768-c6c901677ca5 tempest-VolumeTypesAccessTest-1829881622 None] Lock "cinder-a0f0429d-4fc6-4c55-8900-ae90b5262c8f-delete_volume" released by "delete_volume" :: held 6.339s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:26:11 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.6b7a6795-45be-4009-a2e2-a6431148a9f442l74vxm.img" returned: 0 in 5.407s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:11 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e8570a-b766-4071-9ff3-cb4167c686f6]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:11 devstack sudo[99742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c
Apr 29 10:26:11 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:12 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" returned: 0 in 0.895s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:12 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.6b7a6795-45be-4009-a2e2-a6431148a9f442l74vxm.img {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:26:12 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Converted 1024.00 MB image at 189.35 MB/s
Apr 29 10:26:12 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] 6b7a6795-45be-4009-a2e2-a6431148a9f4 was raw, converting to qcow2 {{(pid=84165) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 29 10:26:12 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b789e58-76af-42e5-a3b0-f78c7203767f]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.6b7a6795-45be-4009-a2e2-a6431148a9f442l74vxm.img {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:12 devstack sudo[99747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.6b7a6795-45be-4009-a2e2-a6431148a9f442l74vxm.img
Apr 29 10:26:12 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:13 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.6b7a6795-45be-4009-a2e2-a6431148a9f442l74vxm.img" returned: 0 in 0.699s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.6b7a6795-45be-4009-a2e2-a6431148a9f442l74vxm.img {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:13 devstack sudo[99751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.6b7a6795-45be-4009-a2e2-a6431148a9f442l74vxm.img
Apr 29 10:26:13 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:13 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.6b7a6795-45be-4009-a2e2-a6431148a9f442l74vxm.img" returned: 1 in 0.733s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.6b7a6795-45be-4009-a2e2-a6431148a9f442l74vxm.img' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:26:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.6b7a6795-45be-4009-a2e2-a6431148a9f442l74vxm.img /opt/stack/data/cinder/conversion/vol_upload_kgg80qqy {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:13 devstack sudo[99757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.6b7a6795-45be-4009-a2e2-a6431148a9f442l74vxm.img /opt/stack/data/cinder/conversion/vol_upload_kgg80qqy
Apr 29 10:26:13 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:14 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.6b7a6795-45be-4009-a2e2-a6431148a9f442l74vxm.img /opt/stack/data/cinder/conversion/vol_upload_kgg80qqy" returned: 0 in 0.613s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:14 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Image conversion details: src /opt/stack/data/cinder/conversion/8dff1fe1-32dc-4e72-ad9d-f61db63ad86c.temp_image.6b7a6795-45be-4009-a2e2-a6431148a9f442l74vxm.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_kgg80qqy {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:26:14 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 29 10:26:14 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85a0bf2-1d9f-4c33-b27d-d8624b2e8112]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kgg80qqy {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:14 devstack sudo[99763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kgg80qqy
Apr 29 10:26:14 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:15 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kgg80qqy" returned: 0 in 0.857s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Acquiring lock "cinder-e9413df1-6b5c-41d7-affd-59a7c34eea31-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:26:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "cinder-e9413df1-6b5c-41d7-affd-59a7c34eea31-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:26:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Acquiring lock "cinder-quobyte-e9413df1-6b5c-41d7-affd-59a7c34eea31" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:26:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "cinder-quobyte-e9413df1-6b5c-41d7-affd-59a7c34eea31" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:26:15 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f8da90-4a9a-4c2e-8028-c9a94570a9d8]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9413df1-6b5c-41d7-affd-59a7c34eea31 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:15 devstack sudo[99770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9413df1-6b5c-41d7-affd-59a7c34eea31
Apr 29 10:26:15 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:16 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9413df1-6b5c-41d7-affd-59a7c34eea31" returned: 0 in 0.761s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9413df1-6b5c-41d7-affd-59a7c34eea31 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:16 devstack sudo[99775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9413df1-6b5c-41d7-affd-59a7c34eea31
Apr 29 10:26:16 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.764s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Uploaded volume to glance image-id: 6b7a6795-45be-4009-a2e2-a6431148a9f4. {{(pid=84165) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 29 10:26:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.798s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b2995ea0-8008-494c-a80f-ac7149daaa85,created_at=2026-04-29T08:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-505823417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b2995ea0-8008-494c-a80f-ac7149daaa85,host='devstack@QuobyteHD#QuobyteHD',id=88facf99-4f5c-436f-ae14-0fa8db3bfbaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c164af154d94d15b2d83fd0a6c1f9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:26:04Z,use_quota=True,user_id='ac7b88178c044f37b2078296e9b15074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7a28933-f319-4808-80d7-75b6f1ab653b),volume_type_id=d7a28933-f319-4808-80d7-75b6f1ab653b)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:26:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Creating volume 88facf99-4f5c-436f-ae14-0fa8db3bfbaa {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:26:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:26:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:26:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:26:16 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:26:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:16 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-fb876c6a-af37-4a79-8c3b-7da9ac8fc430 tempest-VolumesActionsTest-1987562347 None] Copy volume to image completed successfully.
Apr 29 10:26:16 devstack sudo[99777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa 1073741824
Apr 29 10:26:16 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:17 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e9413df1-6b5c-41d7-affd-59a7c34eea31" returned: 0 in 0.681s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:17 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "cinder-quobyte-e9413df1-6b5c-41d7-affd-59a7c34eea31" released by "delete_volume" :: held 1.503s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:26:17 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Created reservations ['f5fd4d56-0392-4cb4-930e-5a80507ea8d3', '3f28e0a9-2615-4c4e-b883-593e5e759b48', '05fb529b-f0ff-4c16-9925-a2dedae857d0', 'f36e3501-1796-4ea9-b814-c207c4100c51'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:26:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:17 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:26:17 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:26:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:17 devstack sudo[99794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:26:17 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:18 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa 1073741824" returned: 0 in 1.222s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Acquiring lock "cinder-5f2aaca8-ba2e-43fc-ae32-efd4563308a7-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "cinder-5f2aaca8-ba2e-43fc-ae32-efd4563308a7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Acquiring lock "cinder-quobyte-5f2aaca8-ba2e-43fc-ae32-efd4563308a7" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:26:18 devstack sudo[99824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa
Apr 29 10:26:18 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "cinder-quobyte-5f2aaca8-ba2e-43fc-ae32-efd4563308a7" acquired by "delete_volume" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:26:18 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.003s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:26:18 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Deleted volume successfully.
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[63db0bc7-e842-4bb7-9a17-ae05e77e8d48]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-919de784-1602-4e1b-8eeb-b6722c2d0e31 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "cinder-e9413df1-6b5c-41d7-affd-59a7c34eea31-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:26:18 devstack sudo[99826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7
Apr 29 10:26:18 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Acquiring lock "cinder-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Lock "cinder-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Acquiring lock "cinder-quobyte-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Lock "cinder-quobyte-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" acquired by "delete_volume" :: waited 0.028s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b59a55-37fc-4e74-8b34-3985a982cd4e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:18 devstack sudo[99828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c
Apr 29 10:26:18 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:19 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa" returned: 0 in 0.915s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] <== create_volume: return (2237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:26:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.240s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c658f210-eb6f-4167-a945-88173e488b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f156b84e-8e4c-44e6-975d-52431f17aff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:19 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Volume volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa (88facf99-4f5c-436f-ae14-0fa8db3bfbaa): created successfully
Apr 29 10:26:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f156b84e-8e4c-44e6-975d-52431f17aff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Flow 'volume_create_manager' (7c213363-3040-4ac6-8c62-34a4b5b6e0cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:26:19 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-7bcd3a19-54b0-4615-80ac-633ffddb1a41 tempest-GroupsTest-925188494 None] Created volume successfully.
Apr 29 10:26:19 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7" returned: 0 in 1.058s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:19 devstack sudo[99837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7
Apr 29 10:26:19 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:19 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" returned: 0 in 0.861s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:19 devstack sudo[99840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c
Apr 29 10:26:19 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:20 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5f2aaca8-ba2e-43fc-ae32-efd4563308a7" returned: 0 in 0.673s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "cinder-quobyte-5f2aaca8-ba2e-43fc-ae32-efd4563308a7" released by "delete_volume" :: held 1.818s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Created reservations ['6649717f-16cf-403c-be2d-7ba6fdf9f87e', '3137bce1-27d5-4bd8-8ccf-990f132d09fe', 'b8dad13f-1de9-4777-9fc4-6ed47ab6b53f', '5ced0f0a-5d9e-4364-90a3-3fd9a8c72319'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:20 devstack sudo[99844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:26:20 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:20 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" returned: 0 in 0.822s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Lock "cinder-quobyte-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c" released by "delete_volume" :: held 1.745s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Created reservations ['e9e1bde6-4401-4ca5-95de-ec96280d1a37', '7a91e124-671f-4574-bfc7-4798c806d420', '13969b37-8624-4949-9c54-837cc0982031', 'd30b07ec-5008-4880-ba5f-5fb956b9a78d'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:26:20 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-fc278d16-54d7-4d85-9133-43a2f3c24f6c tempest-GroupsTest-925188494 None] Update group completed successfully.
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:20 devstack sudo[99849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:26:20 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:21 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.860s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:21 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:26:21 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Deleted volume successfully.
Apr 29 10:26:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8224074a-0a85-47b4-b3ae-431736a7ae56 tempest-AttachVolumeShelveTestJSON-921790343 None] Lock "cinder-5f2aaca8-ba2e-43fc-ae32-efd4563308a7-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:26:21 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.678s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:21 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:26:21 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Deleted volume successfully.
Apr 29 10:26:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8e31bc3e-986a-4c60-8984-6a92f806abdd tempest-VolumesActionsTest-1987562347 None] Lock "cinder-8dff1fe1-32dc-4e72-ad9d-f61db63ad86c-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:26:21 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1550aed0-892a-411c-99da-0b08e042e682 tempest-GroupsTest-925188494 None] Update group completed successfully.
Apr 29 10:26:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Acquiring lock "cinder-quobyte-88facf99-4f5c-436f-ae14-0fa8db3bfbaa" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:26:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Lock "cinder-quobyte-88facf99-4f5c-436f-ae14-0fa8db3bfbaa" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:26:23 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a666f2b0-734e-4bf3-a47b-4d98f344c19f]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:23 devstack sudo[99859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa
Apr 29 10:26:23 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:24 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa" returned: 0 in 0.966s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:24 devstack sudo[99865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa
Apr 29 10:26:24 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:25 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-88facf99-4f5c-436f-ae14-0fa8db3bfbaa" returned: 0 in 0.860s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Lock "cinder-quobyte-88facf99-4f5c-436f-ae14-0fa8db3bfbaa" released by "delete_volume" :: held 1.929s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:26:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Acquiring lock "cinder-quobyte-ca5ab8c8-d725-4561-a263-377fdbfd961a" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:26:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Lock "cinder-quobyte-ca5ab8c8-d725-4561-a263-377fdbfd961a" acquired by "delete_volume" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:26:25 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[767cd428-9417-4321-a0fd-40aa99a97366]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ca5ab8c8-d725-4561-a263-377fdbfd961a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:25 devstack sudo[99868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ca5ab8c8-d725-4561-a263-377fdbfd961a
Apr 29 10:26:25 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:26 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ca5ab8c8-d725-4561-a263-377fdbfd961a" returned: 0 in 1.009s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ca5ab8c8-d725-4561-a263-377fdbfd961a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:26 devstack sudo[99875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ca5ab8c8-d725-4561-a263-377fdbfd961a
Apr 29 10:26:26 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:27 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ca5ab8c8-d725-4561-a263-377fdbfd961a" returned: 0 in 0.863s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Lock "cinder-quobyte-ca5ab8c8-d725-4561-a263-377fdbfd961a" released by "delete_volume" :: held 1.927s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:26:27 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Created reservations ['495d790b-25d7-44cc-acda-42d556479e95'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:26:27 devstack cinder-volume[84165]: WARNING cinder.quota [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-834052119 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-834052119, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:26:27 devstack cinder-volume[84165]: WARNING cinder.quota [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-834052119 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-834052119, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:26:27 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Created reservations ['122c474c-6204-41d6-8d85-14659d35b004', '79e7e479-7903-4525-b9cb-05702bac2450', '9b9aa247-7869-47b5-8c42-1986ecf3a72b', '1a25582b-3cfb-4075-83ac-22ec8bf826d1'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:26:27 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Created reservations ['296e792a-7d97-477c-82f0-ddd9478de106', '9202adf4-533c-40ca-aa85-f96528c82441', 'eb14587d-7528-4c33-b357-171bd55eee00', '184cbab4-59d5-4501-976b-132411bd3313'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:26:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:26:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:26:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:27 devstack sudo[99880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:26:27 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:28 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.651s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:28 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:26:28 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d2f9ff30-4705-46d2-8e8b-5fbf026482d2 tempest-GroupsTest-925188494 None] Delete group completed successfully.
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Flow 'volume_create_manager' (0affd108-48ad-41cd-b4a7-f42bd72fff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c558770d-8752-4860-9921-d61c81db770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Flow 'volume_create_manager' (c6d47b4b-8dc8-45bc-b0fe-5bf7a4c50f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe54dc9-c71d-4c18-a251-ec380f50651a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c558770d-8752-4860-9921-d61c81db770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-950703053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b19abe-2fe7-46d9-b9df-7c8723842e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af3b02856014506bce5a0c2565f5263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:26:30Z,use_quota=True,user_id='be0c61781ab84274b362a8871f50587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c100f4a-68f1-4b1a-bedb-260812d3d163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c100f4a-68f1-4b1a-bedb-260812d3d163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0268dfe-bb01-4698-9fd3-393c21c18d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.image.glance [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Creating Keystone auth plugin from conf {{(pid=84165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe54dc9-c71d-4c18-a251-ec380f50651a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-458167706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57fb598-dd0c-4230-a962-aa415ecdebde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faaeef7220ee41568a91f54d9e0cd70d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:26:30Z,use_quota=True,user_id='31606f13879d43778bcefd9643fca73e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654c3d5c-7d11-49ce-80b5-80789e7dc04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654c3d5c-7d11-49ce-80b5-80789e7dc04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8cd945-b096-48fe-a478-6519600f4ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:30 devstack cinder-volume[84165]: DEBUG cinder.image.glance [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Creating Keystone auth plugin from conf {{(pid=84165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0268dfe-bb01-4698-9fd3-393c21c18d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '54b19abe-2fe7-46d9-b9df-7c8723842e58', 'volume_name': 'volume-54b19abe-2fe7-46d9-b9df-7c8723842e58', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52464ccfe0>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f5b6f9-bad3-4b12-9168-8bca85e49d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f5b6f9-bad3-4b12-9168-8bca85e49d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f6bc35-9f22-47c4-920f-caaf658bb031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:31 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Volume 54b19abe-2fe7-46d9-b9df-7c8723842e58: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-54b19abe-2fe7-46d9-b9df-7c8723842e58', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52464ccfe0>}
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Trying to clone 54b19abe-2fe7-46d9-b9df-7c8723842e58 from image 718e863a-88e0-4753-95be-273177fb3fd1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]). {{(pid=84165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8cd945-b096-48fe-a478-6519600f4ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c57fb598-dd0c-4230-a962-aa415ecdebde', 'volume_name': 'volume-c57fb598-dd0c-4230-a962-aa415ecdebde', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f524656d4c0>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5011f9f-d4af-43e4-a5b0-99e99b076f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5011f9f-d4af-43e4-a5b0-99e99b076f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bbe5289-c58a-44a2-987e-d624431df75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:31 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Volume c57fb598-dd0c-4230-a962-aa415ecdebde: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c57fb598-dd0c-4230-a962-aa415ecdebde', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f524656d4c0>}
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Trying to clone c57fb598-dd0c-4230-a962-aa415ecdebde from image 718e863a-88e0-4753-95be-273177fb3fd1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]). {{(pid=84165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_o7el0ndkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 10:26:31 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_1ny4fx4kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 10:26:31 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e05dd2-9277-4ea3-b47a-5178fa8e4928]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_o7el0ndkdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ed3e4b-64dd-4b5f-8a63-dd1f3361321e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_1ny4fx4kdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:31 devstack sudo[99888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_o7el0ndkdevstack@QuobyteHD
Apr 29 10:26:31 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:31 devstack sudo[99889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_1ny4fx4kdevstack@QuobyteHD
Apr 29 10:26:31 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:32 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_o7el0ndkdevstack@QuobyteHD" returned: 0 in 0.812s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:32 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 is fetched for user be0c61781ab84274b362a8871f50587b. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 10:26:32 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_1ny4fx4kdevstack@QuobyteHD" returned: 0 in 0.787s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:32 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 is fetched for user 31606f13879d43778bcefd9643fca73e. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 10:26:32 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7ffcf9-46d3-45be-b1be-c886ebfd3ac0]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_o7el0ndkdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:32 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8f1bde-f9cf-4a48-b60c-8c385a9dc264]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_1ny4fx4kdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:32 devstack sudo[99898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_o7el0ndkdevstack@QuobyteHD
Apr 29 10:26:32 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:32 devstack sudo[99899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_1ny4fx4kdevstack@QuobyteHD
Apr 29 10:26:32 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:33 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_o7el0ndkdevstack@QuobyteHD" returned: 0 in 0.812s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-950703053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b19abe-2fe7-46d9-b9df-7c8723842e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af3b02856014506bce5a0c2565f5263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:26:30Z,use_quota=True,user_id='be0c61781ab84274b362a8871f50587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:26:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Creating volume 54b19abe-2fe7-46d9-b9df-7c8723842e58 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:26:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:26:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:26:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:26:33 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:33 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:26:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_1ny4fx4kdevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:33 devstack sudo[99910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58 1073741824
Apr 29 10:26:33 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:34 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-ac499aeb-4b3b-4dbe-a00e-adbc9baed589 tempest-GroupsV314Test-605473208 None] Group tempest-GroupsV314Test-Group-1290259788: creating
Apr 29 10:26:34 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-ac499aeb-4b3b-4dbe-a00e-adbc9baed589 tempest-GroupsV314Test-605473208 None] Group tempest-GroupsV314Test-Group-1290259788: created successfully
Apr 29 10:26:34 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-ac499aeb-4b3b-4dbe-a00e-adbc9baed589 tempest-GroupsV314Test-605473208 None] Create group completed successfully.
Apr 29 10:26:34 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58 1073741824" returned: 0 in 0.970s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:34 devstack sudo[99916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58
Apr 29 10:26:34 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:35 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58" returned: 0 in 0.622s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.617s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-458167706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57fb598-dd0c-4230-a962-aa415ecdebde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faaeef7220ee41568a91f54d9e0cd70d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:26:30Z,use_quota=True,user_id='31606f13879d43778bcefd9643fca73e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Creating volume c57fb598-dd0c-4230-a962-aa415ecdebde {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:26:35 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:35 devstack sudo[99919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde 1073741824
Apr 29 10:26:35 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Attempting download of 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume 54b19abe-2fe7-46d9-b9df-7c8723842e58. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c7d5e3-cc06-4d8c-9259-7b668d6061d4]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_s00b5u9h {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:35 devstack sudo[99921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_s00b5u9h
Apr 29 10:26:35 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:36 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_s00b5u9h" returned: 0 in 1.028s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_s00b5u9h {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Flow 'volume_create_manager' (f1b2e5dc-4c5b-47f4-bb77-8a2db3a024bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ec5362-4406-4464-afff-d21b47a94051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ec5362-4406-4464-afff-d21b47a94051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1301819695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb07c8e0-0c02-4ed5-91f2-4ebd15fb659a,host='devstack@QuobyteHD#QuobyteHD',id=c83dca3e-18ca-4c35-8eb0-a2f64f899124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9f8d4c9bd0422c8ee0ba1991d37701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:26:36Z,use_quota=True,user_id='47e85480dac24fdeb179f74b0e469a78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5331aec9-2874-4d56-98ca-f63e71bb5aa6),volume_type_id=5331aec9-2874-4d56-98ca-f63e71bb5aa6)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:36 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4b3378-99ec-4236-b420-9d45a16bb04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4b3378-99ec-4236-b420-9d45a16bb04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126388b0-e6a4-47cd-917c-ef9418950c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126388b0-e6a4-47cd-917c-ef9418950c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c83dca3e-18ca-4c35-8eb0-a2f64f899124', 'volume_name': 'volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ad54d7-1568-491c-9c05-97ec1442752a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ad54d7-1568-491c-9c05-97ec1442752a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3440b38d-3aff-41d4-bece-2deaf6846e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:36 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Volume c83dca3e-18ca-4c35-8eb0-a2f64f899124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124', 'volume_size': 1}
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde 1073741824" returned: 0 in 1.307s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:36 devstack sudo[99930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_s00b5u9h
Apr 29 10:26:36 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:36 devstack sudo[99932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde
Apr 29 10:26:36 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:37 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_s00b5u9h" returned: 1 in 0.826s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_s00b5u9h' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5df2f70-5ac9-4e0c-adcc-5d202cf65942]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_o7el0ndkdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:37 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde" returned: 0 in 0.623s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.668s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=eb07c8e0-0c02-4ed5-91f2-4ebd15fb659a,created_at=2026-04-29T08:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1301819695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb07c8e0-0c02-4ed5-91f2-4ebd15fb659a,host='devstack@QuobyteHD#QuobyteHD',id=c83dca3e-18ca-4c35-8eb0-a2f64f899124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9f8d4c9bd0422c8ee0ba1991d37701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:26:36Z,use_quota=True,user_id='47e85480dac24fdeb179f74b0e469a78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5331aec9-2874-4d56-98ca-f63e71bb5aa6),volume_type_id=5331aec9-2874-4d56-98ca-f63e71bb5aa6)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Creating volume c83dca3e-18ca-4c35-8eb0-a2f64f899124 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:26:37 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:37 devstack sudo[99938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 1073741824
Apr 29 10:26:37 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Attempting download of 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume c57fb598-dd0c-4230-a962-aa415ecdebde. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 10:26:37 devstack sudo[99937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_o7el0ndkdevstack@QuobyteHD
Apr 29 10:26:37 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1940282-de0e-4882-a5fa-a03e99f3127a]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1a1b3plg {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:37 devstack sudo[99941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1a1b3plg
Apr 29 10:26:37 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:38 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_o7el0ndkdevstack@QuobyteHD" returned: 0 in 0.879s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:38 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] 718e863a-88e0-4753-95be-273177fb3fd1 was qcow2, converting to raw {{(pid=84165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 10:26:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_o7el0ndkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:38 devstack sudo[99950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_o7el0ndkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58
Apr 29 10:26:38 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:38 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1a1b3plg" returned: 0 in 0.895s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1a1b3plg {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:38 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 1073741824" returned: 0 in 1.062s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:38 devstack sudo[99955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124
Apr 29 10:26:38 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:38 devstack sudo[99954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1a1b3plg
Apr 29 10:26:38 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:39 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124" returned: 0 in 0.759s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:26:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:39 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1a1b3plg" returned: 1 in 0.872s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_1a1b3plg' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:26:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3440b38d-3aff-41d4-bece-2deaf6846e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed30548-4265-4903-a57b-598a0a836e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:39 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df67b5b-54ab-4354-8f3b-2a5906ef55da]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_1ny4fx4kdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:39 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Volume volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 (c83dca3e-18ca-4c35-8eb0-a2f64f899124): created successfully
Apr 29 10:26:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed30548-4265-4903-a57b-598a0a836e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Flow 'volume_create_manager' (f1b2e5dc-4c5b-47f4-bb77-8a2db3a024bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:26:39 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-97d77eec-ed2f-4f1a-a65f-3516bde3dc1b tempest-GroupsV314Test-605473208 None] Created volume successfully.
Apr 29 10:26:39 devstack sudo[99969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_1ny4fx4kdevstack@QuobyteHD
Apr 29 10:26:39 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:39 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_1ny4fx4kdevstack@QuobyteHD" returned: 0 in 0.824s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:39 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] 718e863a-88e0-4753-95be-273177fb3fd1 was qcow2, converting to raw {{(pid=84165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 10:26:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_1ny4fx4kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:40 devstack sudo[99974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_1ny4fx4kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde
Apr 29 10:26:40 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:40 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_o7el0ndkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58" returned: 0 in 2.523s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:40 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_o7el0ndkdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:26:40 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Converted 112.00 MB image at 44.37 MB/s
Apr 29 10:26:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:40 devstack sudo[99980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58 1G
Apr 29 10:26:40 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:41 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Cloning volume c83dca3e-18ca-4c35-8eb0-a2f64f899124 to volume 5fce1d91-8b38-40d5-929b-8e414429d5d5
Apr 29 10:26:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Creating offline snapshot 47ff46ba-2099-414c-8017-d5ac1f47b997 of volume c83dca3e-18ca-4c35-8eb0-a2f64f899124 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:26:41 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d6579c-5470-4194-af6a-b3082d1c9dbe]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:41 devstack sudo[99986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124
Apr 29 10:26:41 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:41 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58 1G" returned: 0 in 0.942s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:41 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5584dc0-2019-4a9b-a28d-d539680fe4e8]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:41 devstack sudo[99991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58
Apr 29 10:26:41 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:42 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124" returned: 0 in 1.019s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:42 devstack sudo[99997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997 1G
Apr 29 10:26:42 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:42 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_1ny4fx4kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde" returned: 0 in 2.348s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:42 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_1ny4fx4kdevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:26:42 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Converted 112.00 MB image at 47.63 MB/s
Apr 29 10:26:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:42 devstack sudo[100001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde 1G
Apr 29 10:26:42 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:42 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58" returned: 0 in 0.829s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:42 devstack sudo[100003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58
Apr 29 10:26:42 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:43 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde 1G" returned: 0 in 0.851s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fafbd03-9eee-4aad-a1d7-77fafa1c0746]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:43 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997 1G" returned: 0 in 1.103s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:43 devstack sudo[100017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997
Apr 29 10:26:43 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:43 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58" returned: 1 in 0.912s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Downloaded image 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume 54b19abe-2fe7-46d9-b9df-7c8723842e58 successfully. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 10:26:43 devstack sudo[100016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde
Apr 29 10:26:43 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 for user be0c61781ab84274b362a8871f50587b is deleted. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Marking volume 54b19abe-2fe7-46d9-b9df-7c8723842e58 as bootable. {{(pid=84165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Copying metadata from image 718e863a-88e0-4753-95be-273177fb3fd1 to 54b19abe-2fe7-46d9-b9df-7c8723842e58. {{(pid=84165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Creating volume glance metadata for volume 54b19abe-2fe7-46d9-b9df-7c8723842e58 backed by image 718e863a-88e0-4753-95be-273177fb3fd1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f6bc35-9f22-47c4-920f-caaf658bb031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54b19abe-2fe7-46d9-b9df-7c8723842e58', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52464ccfe0>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7578fbf-077d-42ed-bbcb-ab6f6ffb1818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:43 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Volume volume-54b19abe-2fe7-46d9-b9df-7c8723842e58 (54b19abe-2fe7-46d9-b9df-7c8723842e58): created successfully
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7578fbf-077d-42ed-bbcb-ab6f6ffb1818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Flow 'volume_create_manager' (0affd108-48ad-41cd-b4a7-f42bd72fff4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:26:43 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-b2bab947-f096-4f2a-a31c-b1501e5908ae tempest-VolumesImageMetadata-2077516716 None] Created volume successfully.
Apr 29 10:26:44 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:44 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde" returned: 0 in 0.849s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997" returned: 0 in 0.796s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:44 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Acquiring lock "cinder-54b19abe-2fe7-46d9-b9df-7c8723842e58-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:26:44 devstack sudo[100027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997
Apr 29 10:26:44 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Lock "cinder-54b19abe-2fe7-46d9-b9df-7c8723842e58-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Acquiring lock "cinder-quobyte-54b19abe-2fe7-46d9-b9df-7c8723842e58" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Lock "cinder-quobyte-54b19abe-2fe7-46d9-b9df-7c8723842e58" acquired by "delete_volume" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:26:44 devstack sudo[100026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde
Apr 29 10:26:44 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec50325c-e98e-4acc-9a00-8e975cf18855]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:44 devstack sudo[100030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58
Apr 29 10:26:44 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:44 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997" returned: 0 in 0.740s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:44 devstack sudo[100036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.info
Apr 29 10:26:44 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:44 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde" returned: 1 in 0.919s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Downloaded image 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume c57fb598-dd0c-4230-a962-aa415ecdebde successfully. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 for user 31606f13879d43778bcefd9643fca73e is deleted. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 10:26:44 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Marking volume c57fb598-dd0c-4230-a962-aa415ecdebde as bootable. {{(pid=84165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 10:26:45 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Copying metadata from image 718e863a-88e0-4753-95be-273177fb3fd1 to c57fb598-dd0c-4230-a962-aa415ecdebde. {{(pid=84165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 10:26:45 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Creating volume glance metadata for volume c57fb598-dd0c-4230-a962-aa415ecdebde backed by image 718e863a-88e0-4753-95be-273177fb3fd1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 10:26:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bbe5289-c58a-44a2-987e-d624431df75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c57fb598-dd0c-4230-a962-aa415ecdebde', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f524656d4c0>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c75c54-b015-4122-aff6-fb6e6fa45c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:45 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Volume volume-c57fb598-dd0c-4230-a962-aa415ecdebde (c57fb598-dd0c-4230-a962-aa415ecdebde): created successfully
Apr 29 10:26:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c75c54-b015-4122-aff6-fb6e6fa45c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Flow 'volume_create_manager' (c6d47b4b-8dc8-45bc-b0fe-5bf7a4c50f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:26:45 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58" returned: 0 in 0.910s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:45 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-dc466bd8-0cb9-4239-add5-76f0b31f8005 tempest-VolumesExtendTest-1802409580 None] Created volume successfully.
Apr 29 10:26:45 devstack sudo[100040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58
Apr 29 10:26:45 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:45 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.info" returned: 0 in 0.714s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:45 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 10:26:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:45 devstack sudo[100043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.info
Apr 29 10:26:45 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4fa2c5c8-37e9-4a68-ae2c-147a72ab2b52 tempest-VolumesExtendTest-1802409580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:46 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58" returned: 1 in 0.841s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:46 devstack sudo[100048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58
Apr 29 10:26:46 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:46 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.info" returned: 0 in 0.675s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Acquiring lock "cinder-quobyte-5fce1d91-8b38-40d5-929b-8e414429d5d5" by "_copy_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Lock "cinder-quobyte-5fce1d91-8b38-40d5-929b-8e414429d5d5" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] snapshot: 47ff46ba-2099-414c-8017-d5ac1f47b997, volume: 5fce1d91-8b38-40d5-929b-8e414429d5d5,  {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea513274-65e6-4e6f-a1df-ef59f78f31c7]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:46 devstack sudo[100051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997
Apr 29 10:26:46 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:46 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-54b19abe-2fe7-46d9-b9df-7c8723842e58" returned: 0 in 0.668s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Lock "cinder-quobyte-54b19abe-2fe7-46d9-b9df-7c8723842e58" released by "delete_volume" :: held 2.511s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Created reservations ['450d6734-72ba-42fc-96cb-ead643ad953f', '55e16eae-8b8d-4db4-8aa7-3abdf16e253c', 'fcb59322-85c8-40a2-8d99-9cfaffb175f8', '64c022df-fc34-4eae-83c6-6ce7455ba5ea'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:46 devstack sudo[100054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:26:46 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:47 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997" returned: 0 in 0.792s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:26:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 10:26:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Creating direct copy from snapshot {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 10:26:47 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d62f99a-3626-4484-9cfb-c1e911c97962]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:47 devstack sudo[100059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124
Apr 29 10:26:47 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:47 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.609s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:47 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:26:47 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Deleted volume successfully.
Apr 29 10:26:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dd8107db-7f1e-4d36-bdc0-229df874f50c tempest-VolumesImageMetadata-2077516716 None] Lock "cinder-54b19abe-2fe7-46d9-b9df-7c8723842e58-delete_volume" released by "delete_volume" :: held 3.350s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:26:47 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124" returned: 0 in 0.775s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:47 devstack cinder-volume[84165]: DEBUG cinder.utils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Path /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fce1d91-8b38-40d5-929b-8e414429d5d5 not found in is_blk_device check {{(pid=84165) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 10:26:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fce1d91-8b38-40d5-929b-8e414429d5d5 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:47 devstack sudo[100067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fce1d91-8b38-40d5-929b-8e414429d5d5
Apr 29 10:26:47 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:53 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:26:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Flow 'volume_create_manager' (28db9252-e1c2-4e8e-a648-cde19fb46fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:26:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eaf98d6-a283-4ddc-8de5-67a85de2be0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eaf98d6-a283-4ddc-8de5-67a85de2be0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-759399277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7371148c-14a4-4801-ad85-855111de3b27,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53da246765584215b11e6bc6cba69daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:26:53Z,use_quota=True,user_id='ccb8b2d4632f47a7b57286766531985e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09841c62-c7e3-4bec-86ec-405b1f70af89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09841c62-c7e3-4bec-86ec-405b1f70af89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090d4f9c-4e0b-48fd-b1cc-ff917881f6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090d4f9c-4e0b-48fd-b1cc-ff917881f6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7371148c-14a4-4801-ad85-855111de3b27', 'volume_name': 'volume-7371148c-14a4-4801-ad85-855111de3b27', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd9a657-9b3f-4836-bfd2-2bfbd96560ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd9a657-9b3f-4836-bfd2-2bfbd96560ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:26:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91137ef2-0d8f-41a7-b7cc-d5d6fa9f43a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:26:53 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Volume 7371148c-14a4-4801-ad85-855111de3b27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7371148c-14a4-4801-ad85-855111de3b27', 'volume_size': 1}
Apr 29 10:26:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:53 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fce1d91-8b38-40d5-929b-8e414429d5d5" returned: 0 in 5.780s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:53 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[63624c68-3455-47a7-976e-5088b84b52a8]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:53 devstack sudo[100081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124
Apr 29 10:26:53 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:54 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124" returned: 0 in 1.008s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:54 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fce1d91-8b38-40d5-929b-8e414429d5d5 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:26:54 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Converted 1024.00 MB image at 177.11 MB/s
Apr 29 10:26:54 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fce1d91-8b38-40d5-929b-8e414429d5d5 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 10:26:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fce1d91-8b38-40d5-929b-8e414429d5d5 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:54 devstack sudo[100086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fce1d91-8b38-40d5-929b-8e414429d5d5
Apr 29 10:26:54 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:55 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fce1d91-8b38-40d5-929b-8e414429d5d5" returned: 0 in 0.628s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Lock "cinder-quobyte-5fce1d91-8b38-40d5-929b-8e414429d5d5" released by "_copy_volume_from_snapshot" :: held 9.091s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:26:55 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=84,cinder:UPDATE=88,cinder:INSERT=30,cinder:DELETE=5 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:26:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Acquiring lock "cinder-quobyte-47ff46ba-2099-414c-8017-d5ac1f47b997" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:26:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Lock "cinder-quobyte-47ff46ba-2099-414c-8017-d5ac1f47b997" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:26:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Deleting offline snapshot 47ff46ba-2099-414c-8017-d5ac1f47b997 of volume c83dca3e-18ca-4c35-8eb0-a2f64f899124 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:26:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] snapshot_file for this snap is: volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:26:55 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9073648-2962-4b31-ba1c-3ebacc69436d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:55 devstack sudo[100089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997
Apr 29 10:26:55 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:56 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997" returned: 0 in 0.736s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:26:56 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c872b921-cdbe-4238-b62f-2d1cd10ab85b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:56 devstack sudo[100110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124
Apr 29 10:26:56 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:56 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124" returned: 0 in 0.721s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:56 devstack sudo[100115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997
Apr 29 10:26:56 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:57 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997" returned: 0 in 0.772s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:57 devstack sudo[100121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997
Apr 29 10:26:57 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:58 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124.47ff46ba-2099-414c-8017-d5ac1f47b997" returned: 0 in 0.587s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Lock "cinder-quobyte-47ff46ba-2099-414c-8017-d5ac1f47b997" released by "_delete_snapshot" :: held 2.915s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:26:58 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=81,cinder:SELECT=73,cinder:INSERT=33,cinder:DELETE=6 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:26:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.288s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4fa2c5c8-37e9-4a68-ae2c-147a72ab2b52 tempest-VolumesExtendTest-1802409580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 12.495s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04a2dd8-5203-4268-87a7-838a6d79807a]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4fa2c5c8-37e9-4a68-ae2c-147a72ab2b52 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:58 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c6d69592-4cb0-474e-b35c-e972bb5d2f04 tempest-GroupsV314Test-605473208 None] Create group from source-group-eb07c8e0-0c02-4ed5-91f2-4ebd15fb659a completed successfully.
Apr 29 10:26:58 devstack sudo[100124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde
Apr 29 10:26:58 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Acquiring lock "cinder-quobyte-5fce1d91-8b38-40d5-929b-8e414429d5d5" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:26:59 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4fa2c5c8-37e9-4a68-ae2c-147a72ab2b52 tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde" returned: 0 in 0.732s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4fa2c5c8-37e9-4a68-ae2c-147a72ab2b52 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Lock "cinder-quobyte-5fce1d91-8b38-40d5-929b-8e414429d5d5" acquired by "delete_volume" :: waited 0.035s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[77829f77-3a54-4d48-936b-7b91e6ecc1d9]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fce1d91-8b38-40d5-929b-8e414429d5d5 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:59 devstack sudo[100131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde
Apr 29 10:26:59 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:59 devstack sudo[100132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fce1d91-8b38-40d5-929b-8e414429d5d5
Apr 29 10:26:59 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:59 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4fa2c5c8-37e9-4a68-ae2c-147a72ab2b52 tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde" returned: 1 in 0.711s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4fa2c5c8-37e9-4a68-ae2c-147a72ab2b52 tempest-VolumesExtendTest-1802409580 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4fa2c5c8-37e9-4a68-ae2c-147a72ab2b52 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde 2G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4fa2c5c8-37e9-4a68-ae2c-147a72ab2b52 tempest-VolumesExtendTest-1802409580 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde 2G" returned: 0 in 0.059s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4fa2c5c8-37e9-4a68-ae2c-147a72ab2b52 tempest-VolumesExtendTest-1802409580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.555s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:59 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.326s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-759399277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7371148c-14a4-4801-ad85-855111de3b27,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53da246765584215b11e6bc6cba69daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:26:53Z,use_quota=True,user_id='ccb8b2d4632f47a7b57286766531985e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Creating volume 7371148c-14a4-4801-ad85-855111de3b27 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:26:59 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7371148c-14a4-4801-ad85-855111de3b27 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fce1d91-8b38-40d5-929b-8e414429d5d5" returned: 0 in 0.758s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:26:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fce1d91-8b38-40d5-929b-8e414429d5d5 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:26:59 devstack sudo[100144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7371148c-14a4-4801-ad85-855111de3b27 1073741824
Apr 29 10:26:59 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:59 devstack sudo[100145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fce1d91-8b38-40d5-929b-8e414429d5d5
Apr 29 10:26:59 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:26:59 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-4fa2c5c8-37e9-4a68-ae2c-147a72ab2b52 tempest-VolumesExtendTest-1802409580 None] Extend volume completed successfully.
Apr 29 10:27:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Acquiring lock "cinder-c57fb598-dd0c-4230-a962-aa415ecdebde-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Lock "cinder-c57fb598-dd0c-4230-a962-aa415ecdebde-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Acquiring lock "cinder-quobyte-c57fb598-dd0c-4230-a962-aa415ecdebde" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:00 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fce1d91-8b38-40d5-929b-8e414429d5d5" returned: 0 in 0.834s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Lock "cinder-quobyte-c57fb598-dd0c-4230-a962-aa415ecdebde" acquired by "delete_volume" :: waited 0.068s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Lock "cinder-quobyte-5fce1d91-8b38-40d5-929b-8e414429d5d5" released by "delete_volume" :: held 1.683s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:00 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a21b39-acf1-40ee-bda9-1e4be6aef70a]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:01 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Created reservations ['bdb363ed-32f7-4eaa-a292-1dca8cf87e7b'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:27:01 devstack sudo[100176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde
Apr 29 10:27:01 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:01 devstack cinder-volume[84165]: WARNING cinder.quota [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1129278418 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1129278418, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:27:01 devstack cinder-volume[84165]: WARNING cinder.quota [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1129278418 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1129278418, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:27:01 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Created reservations ['91bfdba2-74be-4db3-a47a-0478d028f708', '2b114e26-11c8-452f-98e7-7813037c2a2f', 'ab884338-7040-4298-bb66-7331cb94ebc4', '83cbf1a1-bc36-4984-8c31-06e9cb770786'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:27:01 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7371148c-14a4-4801-ad85-855111de3b27 1073741824" returned: 0 in 1.343s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7371148c-14a4-4801-ad85-855111de3b27 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:01 devstack sudo[100208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7371148c-14a4-4801-ad85-855111de3b27
Apr 29 10:27:01 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:01 devstack sudo[100214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:27:01 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:02 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde" returned: 0 in 1.148s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:02 devstack sudo[100225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde
Apr 29 10:27:02 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:02 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7371148c-14a4-4801-ad85-855111de3b27" returned: 0 in 1.069s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] <== create_volume: return (2499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.504s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91137ef2-0d8f-41a7-b7cc-d5d6fa9f43a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7371148c-14a4-4801-ad85-855111de3b27', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96450d5a-c2cc-42b4-b9cc-cc0feb67c7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:02 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Volume volume-7371148c-14a4-4801-ad85-855111de3b27 (7371148c-14a4-4801-ad85-855111de3b27): created successfully
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96450d5a-c2cc-42b4-b9cc-cc0feb67c7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Flow 'volume_create_manager' (28db9252-e1c2-4e8e-a648-cde19fb46fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a6c12cd1-86db-4863-ad11-c1a419ec021c tempest-VolumesListTestJSON-1075035717 None] Created volume successfully.
Apr 29 10:27:02 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.131s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:27:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-eb07876b-1e2c-4800-974c-a2bade0ef8fd tempest-GroupsV314Test-605473208 None] Delete group completed successfully.
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] Acquiring lock "cinder-quobyte-c83dca3e-18ca-4c35-8eb0-a2f64f899124" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] Lock "cinder-quobyte-c83dca3e-18ca-4c35-8eb0-a2f64f899124" acquired by "delete_volume" :: waited 0.024s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e40377f-3669-4933-8181-f8363c6e3b66]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:02 devstack sudo[100230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124
Apr 29 10:27:02 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:02 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde" returned: 1 in 0.972s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:27:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:03 devstack sudo[100235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde
Apr 29 10:27:03 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:03 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124" returned: 0 in 1.061s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:03 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:03 devstack sudo[100243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124
Apr 29 10:27:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c57fb598-dd0c-4230-a962-aa415ecdebde" returned: 0 in 0.891s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:03 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Lock "cinder-quobyte-c57fb598-dd0c-4230-a962-aa415ecdebde" released by "delete_volume" :: held 3.132s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Created reservations ['af6f5926-6366-4c69-a092-d20bf2eeffed', 'eb07b1b8-c147-4fad-93e6-3324cbadf6ae', 'b60b6e40-26d1-4ad8-a9b9-7ad025f0a3d2', 'eb7ebe1c-efd7-470f-80e4-873a9cb61699'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Flow 'volume_create_manager' (3c33779d-0940-4b0a-bc0c-64802d83c43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2e89ea-1821-419d-8bb1-a2bbea71ca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2e89ea-1821-419d-8bb1-a2bbea71ca47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-785583042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d48f93d-1cf4-4cea-bf65-c76c53ee92e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53da246765584215b11e6bc6cba69daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:04Z,use_quota=True,user_id='ccb8b2d4632f47a7b57286766531985e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600b11d8-3770-454b-ac4c-8a02d02e6feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600b11d8-3770-454b-ac4c-8a02d02e6feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe81bbe-fba4-425e-8a31-66273be76e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe81bbe-fba4-425e-8a31-66273be76e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d48f93d-1cf4-4cea-bf65-c76c53ee92e0', 'volume_name': 'volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:04 devstack sudo[100245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6326481-55a4-4c22-b63d-3ed27125eb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:04 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6326481-55a4-4c22-b63d-3ed27125eb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9770776-e65e-40b4-ad8a-db042596f33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:04 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Volume 2d48f93d-1cf4-4cea-bf65-c76c53ee92e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0', 'volume_size': 1}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-785583042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d48f93d-1cf4-4cea-bf65-c76c53ee92e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53da246765584215b11e6bc6cba69daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:04Z,use_quota=True,user_id='ccb8b2d4632f47a7b57286766531985e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Creating volume 2d48f93d-1cf4-4cea-bf65-c76c53ee92e0 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:27:04 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:04 devstack sudo[100247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0 1073741824
Apr 29 10:27:04 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:27:04 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Flow 'volume_create_manager' (238aa9c8-d89e-4c87-b303-22edfb7ffee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adb936d-b885-4a53-9f8c-60e106f8bd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83dca3e-18ca-4c35-8eb0-a2f64f899124" returned: 0 in 1.116s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adb936d-b885-4a53-9f8c-60e106f8bd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-491048241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faaeef7220ee41568a91f54d9e0cd70d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:05Z,use_quota=True,user_id='31606f13879d43778bcefd9643fca73e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38ec51dc-8d71-4a62-ad03-11ce8fd29178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38ec51dc-8d71-4a62-ad03-11ce8fd29178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e79221-2e52-4a07-9deb-94a759c7a2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e79221-2e52-4a07-9deb-94a759c7a2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b', 'volume_name': 'volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8e7c65-9cff-49ef-8a5f-506df0a9b69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8e7c65-9cff-49ef-8a5f-506df0a9b69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85779b0e-dc49-430b-bdc5-f20a97b6deb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:05 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Volume ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b', 'volume_size': 1}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] Lock "cinder-quobyte-c83dca3e-18ca-4c35-8eb0-a2f64f899124" released by "delete_volume" :: held 2.341s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] Created reservations ['dfe763bf-0fd7-4621-add1-35eb4f1307cb'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] Created reservations ['2363b700-f287-4bd2-8fef-365e5c2409ed', 'e777fe1d-7044-4980-bbd5-64073ec9e12f', '67a69345-8099-4828-8c95-7191cc91c441', '2c5eda55-c560-47f3-8781-627ad62b3a5b'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:05 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.317s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:27:05 devstack sudo[100255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:27:05 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:05 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Deleted volume successfully.
Apr 29 10:27:05 devstack sudo[100256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:27:05 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b4ee4440-6354-4564-ae96-b33c786831e6 tempest-VolumesExtendTest-1802409580 None] Lock "cinder-c57fb598-dd0c-4230-a962-aa415ecdebde-delete_volume" released by "delete_volume" :: held 4.949s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:05 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0 1073741824" returned: 0 in 1.410s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:05 devstack sudo[100259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0
Apr 29 10:27:05 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:06 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.072s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:27:06 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.289s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:27:06 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c92057f6-3cc2-4e3d-a046-44cb5c27abc7 tempest-GroupsV314Test-605473208 None] Delete group completed successfully.
Apr 29 10:27:06 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0" returned: 0 in 1.125s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] <== create_volume: return (2624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.627s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.838s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-491048241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faaeef7220ee41568a91f54d9e0cd70d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:05Z,use_quota=True,user_id='31606f13879d43778bcefd9643fca73e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Creating volume ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:27:06 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:06 devstack sudo[100265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b 1073741824
Apr 29 10:27:06 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9770776-e65e-40b4-ad8a-db042596f33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b775f0c0-a337-40be-b1d9-5e40fc03e257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:06 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Volume volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0 (2d48f93d-1cf4-4cea-bf65-c76c53ee92e0): created successfully
Apr 29 10:27:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b775f0c0-a337-40be-b1d9-5e40fc03e257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Flow 'volume_create_manager' (3c33779d-0940-4b0a-bc0c-64802d83c43c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:07 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-7077161d-4562-4a5b-81bb-537ab9b5cd42 tempest-VolumesListTestJSON-1075035717 None] Created volume successfully.
Apr 29 10:27:07 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b 1073741824" returned: 0 in 1.062s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:27:08 devstack sudo[100272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b
Apr 29 10:27:08 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Flow 'volume_create_manager' (c5e54675-bcbc-4928-b0a4-dfcfb14b3e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3664a3-c1d5-453e-adbf-7264be4dd6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3664a3-c1d5-453e-adbf-7264be4dd6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-769707213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53da246765584215b11e6bc6cba69daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:08Z,use_quota=True,user_id='ccb8b2d4632f47a7b57286766531985e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301f2484-e092-45a9-bbb8-f506aec3fdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301f2484-e092-45a9-bbb8-f506aec3fdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641356b6-dd62-4679-ae18-c2edad266973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641356b6-dd62-4679-ae18-c2edad266973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc', 'volume_name': 'volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4501c193-c6e5-4fce-a2a0-485b087796ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4501c193-c6e5-4fce-a2a0-485b087796ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b837c9-f901-401d-ab47-5db848037447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:08 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Volume 34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc', 'volume_size': 1}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:08 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b" returned: 0 in 0.750s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-769707213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53da246765584215b11e6bc6cba69daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:08Z,use_quota=True,user_id='ccb8b2d4632f47a7b57286766531985e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Creating volume 34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:27:08 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:08 devstack sudo[100275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc 1073741824
Apr 29 10:27:08 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85779b0e-dc49-430b-bdc5-f20a97b6deb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5663d891-7585-45cf-9f5a-7c9406346c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:08 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Volume volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b (ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b): created successfully
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5663d891-7585-45cf-9f5a-7c9406346c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Flow 'volume_create_manager' (238aa9c8-d89e-4c87-b303-22edfb7ffee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:08 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c1a14aa4-5e2e-4c6f-b1ca-97cf25b12abe tempest-VolumesExtendTest-1802409580 None] Created volume successfully.
Apr 29 10:27:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:09 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc 1073741824" returned: 0 in 1.014s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:09 devstack sudo[100282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc
Apr 29 10:27:09 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:10 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc" returned: 0 in 0.633s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:27:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.994s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b837c9-f901-401d-ab47-5db848037447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f082c043-d13f-499c-8532-84929895f167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] Creating offline snapshot cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c of volume ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:27:10 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Volume volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc (34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc): created successfully
Apr 29 10:27:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f082c043-d13f-499c-8532-84929895f167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Flow 'volume_create_manager' (c5e54675-bcbc-4928-b0a4-dfcfb14b3e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:10 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8080a1f-fb9c-442e-83aa-af54e27ae0cb]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:10 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0fdaf9a4-99d7-4be5-ba91-31594e62b0a0 tempest-VolumesListTestJSON-1075035717 None] Created volume successfully.
Apr 29 10:27:10 devstack sudo[100285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b
Apr 29 10:27:10 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:11 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b" returned: 0 in 0.864s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:11 devstack sudo[100290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c 1G
Apr 29 10:27:11 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:11 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:27:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Flow 'volume_create_manager' (60cc6c77-dfd6-4c38-a0b6-78b92283456b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94508e40-0743-4f41-b3d8-cbe1cb2936d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94508e40-0743-4f41-b3d8-cbe1cb2936d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2136694978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43fe76b4-bd38-4953-88e0-17699ca5b1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522dfb4822614ced9c26ea945a315a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:12Z,use_quota=True,user_id='af713a6b36ee4f34843c18f37819c680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e8474c-9c41-42f2-ac2b-8c660c9ddfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e8474c-9c41-42f2-ac2b-8c660c9ddfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ddf170-bc45-44c1-8614-c87d12708ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ddf170-bc45-44c1-8614-c87d12708ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43fe76b4-bd38-4953-88e0-17699ca5b1fa', 'volume_name': 'volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712bcc2f-c1c4-4fac-a0a2-aa1fb824977d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712bcc2f-c1c4-4fac-a0a2-aa1fb824977d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1594dd-298e-4118-9c7b-0763a8ca4469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:11 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Volume 43fe76b4-bd38-4953-88e0-17699ca5b1fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa', 'volume_size': 1}
Apr 29 10:27:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:12 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c 1G" returned: 0 in 0.930s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:12 devstack sudo[100296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c
Apr 29 10:27:12 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:13 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c" returned: 0 in 0.739s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:13 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c is being set with open permissions: ugo+rw
Apr 29 10:27:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:13 devstack sudo[100301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c
Apr 29 10:27:13 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:13 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c" returned: 0 in 0.686s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:13 devstack sudo[100305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.info
Apr 29 10:27:13 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:13 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Acquiring lock "cinder-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Lock "cinder-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Acquiring lock "cinder-quobyte-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Lock "cinder-quobyte-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:14 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee8523d-d28a-4ab9-9702-1f85499be6cf]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:14 devstack sudo[100307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc
Apr 29 10:27:14 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:14 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.info" returned: 0 in 0.701s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:14 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.info is being set with open permissions: ugo+rw
Apr 29 10:27:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:14 devstack sudo[100318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.info
Apr 29 10:27:14 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:14 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc" returned: 0 in 0.780s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:14 devstack sudo[100331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc
Apr 29 10:27:14 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:15 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.info" returned: 0 in 0.620s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.668s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.227s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2136694978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43fe76b4-bd38-4953-88e0-17699ca5b1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522dfb4822614ced9c26ea945a315a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:12Z,use_quota=True,user_id='af713a6b36ee4f34843c18f37819c680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Creating volume 43fe76b4-bd38-4953-88e0-17699ca5b1fa {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:27:15 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:15 devstack sudo[100334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa 1073741824
Apr 29 10:27:15 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:15 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-7668fc95-17c9-42eb-ba08-ed667ef00878 tempest-VolumesExtendTest-1802409580 None] Create snapshot completed successfully
Apr 29 10:27:15 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc" returned: 0 in 0.635s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Lock "cinder-quobyte-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc" released by "delete_volume" :: held 1.457s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Created reservations ['25cbd85f-1d87-4c62-8209-9abb734cd1dd', '3e055cb7-99c0-4fe7-a6ae-261c07433064', '7a32199f-f5f1-4f1c-80f8-993352979d49', '9279f28d-85b3-4451-9616-2d09e45be8d1'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:15 devstack sudo[100337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:27:15 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-efafafed-7fb8-4404-8bec-46a9fff1c704 tempest-VolumesExtendTest-1802409580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:16 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa 1073741824" returned: 0 in 0.872s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:16 devstack sudo[100345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa
Apr 29 10:27:16 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:16 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.624s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:27:16 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Deleted volume successfully.
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df15cfa8-1374-40fb-9606-da89aeff0f7b tempest-VolumesListTestJSON-1075035717 None] Lock "cinder-34fe22bf-7e6b-4a71-aadd-d8318c5f4bfc-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Acquiring lock "cinder-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Lock "cinder-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Acquiring lock "cinder-quobyte-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Lock "cinder-quobyte-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[69793026-cef2-4fce-aaa8-9d214e6ae3ed]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:16 devstack sudo[100348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0
Apr 29 10:27:16 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:16 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa" returned: 0 in 0.654s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-efafafed-7fb8-4404-8bec-46a9fff1c704 tempest-VolumesExtendTest-1802409580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.774s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1594dd-298e-4118-9c7b-0763a8ca4469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa18de75-5bea-43da-93b4-f5d36c253c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd47c4ef-2d3b-425f-b6f1-e340783480a7]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-efafafed-7fb8-4404-8bec-46a9fff1c704 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:16 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Volume volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa (43fe76b4-bd38-4953-88e0-17699ca5b1fa): created successfully
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa18de75-5bea-43da-93b4-f5d36c253c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Flow 'volume_create_manager' (60cc6c77-dfd6-4c38-a0b6-78b92283456b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:16 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d6562fb2-c8e8-4faa-8073-248af26b336c tempest-VolumesDeleteCascade-1536392241 None] Created volume successfully.
Apr 29 10:27:16 devstack sudo[100351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b
Apr 29 10:27:16 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:17 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0" returned: 0 in 0.751s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:17 devstack sudo[100356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0
Apr 29 10:27:17 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:17 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-efafafed-7fb8-4404-8bec-46a9fff1c704 tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b" returned: 0 in 0.739s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-efafafed-7fb8-4404-8bec-46a9fff1c704 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c 2G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-efafafed-7fb8-4404-8bec-46a9fff1c704 tempest-VolumesExtendTest-1802409580 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c 2G" returned: 0 in 0.127s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-efafafed-7fb8-4404-8bec-46a9fff1c704 tempest-VolumesExtendTest-1802409580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.917s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.298s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:17 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] Creating offline snapshot 77ac831f-8876-4c07-97f5-63565fe86617 of volume 43fe76b4-bd38-4953-88e0-17699ca5b1fa {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:27:17 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7311b849-d679-4947-9ac3-4cbf931a1805]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:17 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-efafafed-7fb8-4404-8bec-46a9fff1c704 tempest-VolumesExtendTest-1802409580 None] Extend volume completed successfully.
Apr 29 10:27:17 devstack sudo[100364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa
Apr 29 10:27:17 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:17 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0" returned: 0 in 0.625s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Lock "cinder-quobyte-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0" released by "delete_volume" :: held 1.427s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Created reservations ['70df177b-3351-473f-ad5a-a16bcada1b7e', '1edbe956-d31e-4b34-a586-a7033a1afae3', 'be855c04-e603-4cb0-bb18-90af7dea7a4d', 'a6ce5253-df37-477b-a98d-fa1e98e97d9a'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:18 devstack sudo[100367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:27:18 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Acquiring lock "cinder-cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Lock "cinder-cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Acquiring lock "cinder-quobyte-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Lock "cinder-quobyte-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Acquiring lock "cinder-quobyte-cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Lock "cinder-quobyte-cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Deleting offline snapshot cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c of volume ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] snapshot_file for this snap is: volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e182e639-aa9e-422e-9251-57f2319e8f49]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:18 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa" returned: 0 in 0.836s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:18 devstack sudo[100409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617 1G
Apr 29 10:27:18 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:18 devstack sudo[100408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c
Apr 29 10:27:18 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:18 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.750s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:27:18 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Deleted volume successfully.
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Acquiring lock "cinder-7371148c-14a4-4801-ad85-855111de3b27-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e48f5c7a-28db-468f-8b70-79e5c47c3d43 tempest-VolumesListTestJSON-1075035717 None] Lock "cinder-2d48f93d-1cf4-4cea-bf65-c76c53ee92e0-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Lock "cinder-7371148c-14a4-4801-ad85-855111de3b27-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Acquiring lock "cinder-quobyte-7371148c-14a4-4801-ad85-855111de3b27" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Lock "cinder-quobyte-7371148c-14a4-4801-ad85-855111de3b27" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:19 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a80b3d-9aea-4898-b303-010affda07ac]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7371148c-14a4-4801-ad85-855111de3b27 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:19 devstack sudo[100413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7371148c-14a4-4801-ad85-855111de3b27
Apr 29 10:27:19 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:19 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c" returned: 0 in 0.917s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:27:19 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a71e02-c40d-41f6-b5fa-05548d062f9f]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:19 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617 1G" returned: 0 in 0.940s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:19 devstack sudo[100424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617
Apr 29 10:27:19 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:19 devstack sudo[100423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b
Apr 29 10:27:19 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:19 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7371148c-14a4-4801-ad85-855111de3b27" returned: 0 in 0.791s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7371148c-14a4-4801-ad85-855111de3b27 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:19 devstack sudo[100430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7371148c-14a4-4801-ad85-855111de3b27
Apr 29 10:27:19 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:20 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617" returned: 0 in 0.712s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:20 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617 is being set with open permissions: ugo+rw
Apr 29 10:27:20 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b" returned: 0 in 0.756s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:20 devstack sudo[100438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617
Apr 29 10:27:20 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:20 devstack sudo[100439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c
Apr 29 10:27:20 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:20 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7371148c-14a4-4801-ad85-855111de3b27" returned: 0 in 0.631s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:20 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Lock "cinder-quobyte-7371148c-14a4-4801-ad85-855111de3b27" released by "delete_volume" :: held 1.472s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:20 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Created reservations ['4bb46a95-27b5-4dc8-8560-937a05d66c40', 'b00ec4e5-97ed-4d29-b803-81d6c15ae64a', 'df58df46-cb76-4d89-8792-acf7760b9048', '5ff20d10-a764-4c9f-9d89-d5eeb6620b4b'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:27:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:20 devstack sudo[100449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:27:20 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:20 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617" returned: 0 in 0.747s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:21 devstack sudo[100462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.info
Apr 29 10:27:21 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:21 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c" returned: 0 in 0.827s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:21 devstack sudo[100464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c
Apr 29 10:27:21 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:21 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.703s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:21 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:27:21 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Deleted volume successfully.
Apr 29 10:27:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5daa9693-bfb8-43bb-a3b1-5182aa10942b tempest-VolumesListTestJSON-1075035717 None] Lock "cinder-7371148c-14a4-4801-ad85-855111de3b27-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:21 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b.cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c" returned: 0 in 0.718s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:21 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.info" returned: 0 in 0.800s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:21 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.info is being set with open permissions: ugo+rw
Apr 29 10:27:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Lock "cinder-quobyte-cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c" released by "_delete_snapshot" :: held 3.362s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Lock "cinder-quobyte-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b" released by "delete_snapshot" :: held 3.397s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:21 devstack sudo[100470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.info
Apr 29 10:27:21 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:21 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Created reservations ['f8ac9c91-9e75-460c-951f-47874faa219f', 'd4a1d3df-7c24-4b43-985f-df14df57d681', '5ec92bff-ef74-4907-8390-c101f43de7f3', 'ad415bd1-d0f2-4bcc-b118-f51c5fc90b0f'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:27:21 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Delete snapshot completed successfully.
Apr 29 10:27:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bd7cbe4b-d69c-4283-9eef-9a32c793f6a8 tempest-VolumesExtendTest-1802409580 None] Lock "cinder-cd7841f9-1a4e-4aaf-9a2b-4aaf107b016c-delete_snapshot" released by "delete_snapshot" :: held 3.561s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:22 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.info" returned: 0 in 0.647s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.802s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:22 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-48ab3850-a274-486c-9f06-24f78a7ae34d tempest-VolumesDeleteCascade-1536392241 None] Create snapshot completed successfully
Apr 29 10:27:22 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Acquiring lock "cinder-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:22 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Lock "cinder-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3cf1668e-29b5-459b-bb74-eb5cc4174cc0 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3cf1668e-29b5-459b-bb74-eb5cc4174cc0 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-3cf1668e-29b5-459b-bb74-eb5cc4174cc0 tempest-VolumesDeleteCascade-1536392241 None] Creating offline snapshot da32a002-c689-4eac-81f6-bd611d200f16 of volume 43fe76b4-bd38-4953-88e0-17699ca5b1fa {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:27:22 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a536c7b6-df05-472c-939c-7276753db615]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cf1668e-29b5-459b-bb74-eb5cc4174cc0 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Acquiring lock "cinder-quobyte-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Lock "cinder-quobyte-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b" acquired by "delete_volume" :: waited 0.026s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:23 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[785c27e9-bc25-4557-88de-e1301b4749d0]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:23 devstack sudo[100473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617
Apr 29 10:27:23 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:23 devstack sudo[100474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b
Apr 29 10:27:23 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:23 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cf1668e-29b5-459b-bb74-eb5cc4174cc0 tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617" returned: 0 in 0.874s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-3cf1668e-29b5-459b-bb74-eb5cc4174cc0 tempest-VolumesDeleteCascade-1536392241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:27:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cf1668e-29b5-459b-bb74-eb5cc4174cc0 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:23 devstack sudo[100481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16 1G
Apr 29 10:27:23 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:24 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b" returned: 0 in 0.979s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:24 devstack sudo[100488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b
Apr 29 10:27:24 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:24 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cf1668e-29b5-459b-bb74-eb5cc4174cc0 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16 1G" returned: 0 in 1.030s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:24 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cf1668e-29b5-459b-bb74-eb5cc4174cc0 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b" returned: 0 in 0.823s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:24 devstack sudo[100495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16
Apr 29 10:27:24 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Lock "cinder-quobyte-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b" released by "delete_volume" :: held 1.921s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:25 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Created reservations ['a69f88ab-72da-440f-a36c-16d676793244', '56eb3333-7d55-4c10-a92d-91b9c5c4bca4', '24210710-a56c-4f72-ab23-571563434058', '755457e1-5fe9-435d-ae3e-bf7ccfc5e2a2'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:27:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:25 devstack sudo[100497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:27:25 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:25 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cf1668e-29b5-459b-bb74-eb5cc4174cc0 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16" returned: 0 in 0.727s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:25 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-3cf1668e-29b5-459b-bb74-eb5cc4174cc0 tempest-VolumesDeleteCascade-1536392241 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16 is being set with open permissions: ugo+rw
Apr 29 10:27:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cf1668e-29b5-459b-bb74-eb5cc4174cc0 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:25 devstack sudo[100503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16
Apr 29 10:27:25 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:25 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.648s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:25 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:27:25 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Deleted volume successfully.
Apr 29 10:27:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e9da49a5-fb70-4aa1-a254-668244145fdf tempest-VolumesExtendTest-1802409580 None] Lock "cinder-ab14a1fb-318a-42d0-8b2f-2c69f62e3a6b-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:26 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cf1668e-29b5-459b-bb74-eb5cc4174cc0 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16" returned: 0 in 0.674s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3cf1668e-29b5-459b-bb74-eb5cc4174cc0 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.457s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:26 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3cf1668e-29b5-459b-bb74-eb5cc4174cc0 tempest-VolumesDeleteCascade-1536392241 None] Create snapshot completed successfully
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-43fe76b4-bd38-4953-88e0-17699ca5b1fa-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-43fe76b4-bd38-4953-88e0-17699ca5b1fa-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Performing cascade delete. {{(pid=84165) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-77ac831f-8876-4c07-97f5-63565fe86617-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-77ac831f-8876-4c07-97f5-63565fe86617-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-quobyte-43fe76b4-bd38-4953-88e0-17699ca5b1fa" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-43fe76b4-bd38-4953-88e0-17699ca5b1fa" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-quobyte-77ac831f-8876-4c07-97f5-63565fe86617" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-77ac831f-8876-4c07-97f5-63565fe86617" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Deleting offline snapshot 77ac831f-8876-4c07-97f5-63565fe86617 of volume 43fe76b4-bd38-4953-88e0-17699ca5b1fa {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] snapshot_file for this snap is: volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f653e9-dda7-40cb-9eb3-478ba5ebceb5]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Flow 'volume_create_manager' (be3e3b07-1f1b-4c70-bf93-bf9b767377a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dad3f42-2c37-4a4d-9c8c-e4ce1cc102c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dad3f42-2c37-4a4d-9c8c-e4ce1cc102c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2119627696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83168d6-49ee-4a5f-bbcc-47ee668cc988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00d318c9a004d64bce2b22ee45b192e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:27Z,use_quota=True,user_id='3afc570f73c94205893b9a803e3e0cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbb50cb-1076-4b11-9327-bd36ded822c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:27 devstack sudo[100515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617
Apr 29 10:27:27 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbb50cb-1076-4b11-9327-bd36ded822c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb711c80-625e-4134-8d9d-b754ab585c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb711c80-625e-4134-8d9d-b754ab585c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c83168d6-49ee-4a5f-bbcc-47ee668cc988', 'volume_name': 'volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3fa22d6-80ff-4586-adde-321f6d9f1b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3fa22d6-80ff-4586-adde-321f6d9f1b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f987f301-12e7-45ce-814f-f250a13823f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:27 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Volume c83168d6-49ee-4a5f-bbcc-47ee668cc988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988', 'volume_size': 1}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2119627696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83168d6-49ee-4a5f-bbcc-47ee668cc988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00d318c9a004d64bce2b22ee45b192e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:27Z,use_quota=True,user_id='3afc570f73c94205893b9a803e3e0cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Creating volume c83168d6-49ee-4a5f-bbcc-47ee668cc988 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:27:27 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:27:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:27 devstack sudo[100517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988 1073741824
Apr 29 10:27:27 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:28 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617" returned: 0 in 0.885s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:27:28 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0471502-2ba7-4424-9ab2-4b685c010e54]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:28 devstack sudo[100526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa
Apr 29 10:27:28 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:28 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988 1073741824" returned: 0 in 0.995s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:28 devstack sudo[100529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988
Apr 29 10:27:28 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:29 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa" returned: 0 in 0.925s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:29 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c87be1-7dc2-4772-8c39-1595ed545e14]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:29 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988" returned: 0 in 0.713s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:27:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f987f301-12e7-45ce-814f-f250a13823f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b34038-b003-400c-9569-07a1026dad45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:29 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Volume volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988 (c83168d6-49ee-4a5f-bbcc-47ee668cc988): created successfully
Apr 29 10:27:29 devstack sudo[100535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16
Apr 29 10:27:29 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b34038-b003-400c-9569-07a1026dad45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Flow 'volume_create_manager' (be3e3b07-1f1b-4c70-bf93-bf9b767377a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:29 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-95331bfb-516f-4a3b-8a21-02b5a804258d tempest-AttachVolumeTestJSON-1917629784 None] Created volume successfully.
Apr 29 10:27:30 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16" returned: 0 in 0.921s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:27:30 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e9af05-85ca-4f89-9bb0-8afc39bfdb93]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:30 devstack sudo[100540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617
Apr 29 10:27:30 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:31 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617" returned: 0 in 0.872s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:27:31 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[21418a41-fc5f-4e54-b7ad-10c057246670]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:31 devstack sudo[100545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa
Apr 29 10:27:31 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:32 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa" returned: 0 in 0.876s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:32 devstack sudo[100551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617
Apr 29 10:27:32 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-6d0a5c1d-5099-4d7a-b4b0-5b298cacae2e req-99aea91a-b1c7-4bac-9989-8ad65026142d tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-6d0a5c1d-5099-4d7a-b4b0-5b298cacae2e req-99aea91a-b1c7-4bac-9989-8ad65026142d tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:33 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617" returned: 0 in 1.019s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:33 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f077db-896d-45fd-bcbf-736a3940a21b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-6d0a5c1d-5099-4d7a-b4b0-5b298cacae2e req-99aea91a-b1c7-4bac-9989-8ad65026142d tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:33 devstack sudo[100564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617
Apr 29 10:27:33 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:33 devstack sudo[100565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988
Apr 29 10:27:33 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:33 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.77ac831f-8876-4c07-97f5-63565fe86617" returned: 0 in 0.793s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16 -F qcow2 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:33 devstack sudo[100573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16 -F qcow2
Apr 29 10:27:33 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:33 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Flow 'volume_create_manager' (31fc55e6-197b-4fc8-8a3d-91764c2db04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:34 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cac7945-9345-4b01-a12c-7f6ad07b2fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-6d0a5c1d-5099-4d7a-b4b0-5b298cacae2e req-99aea91a-b1c7-4bac-9989-8ad65026142d tempest-AttachVolumeTestJSON-1917629784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988" returned: 0 in 0.968s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-6d0a5c1d-5099-4d7a-b4b0-5b298cacae2e req-99aea91a-b1c7-4bac-9989-8ad65026142d tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.014s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cac7945-9345-4b01-a12c-7f6ad07b2fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1483420768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b83dae-bd39-4a82-af96-eb272ca71d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abbf7596ffc413db22862681b735386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:34Z,use_quota=True,user_id='d8ee84647d8c44149963ad17a1f8ea74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a965ef-5d7e-4c41-958a-42a38d38820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a965ef-5d7e-4c41-958a-42a38d38820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636ab94d-97f8-46ef-8cb5-4b44d818f2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636ab94d-97f8-46ef-8cb5-4b44d818f2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b83dae-bd39-4a82-af96-eb272ca71d73', 'volume_name': 'volume-06b83dae-bd39-4a82-af96-eb272ca71d73', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562665d0-08eb-4973-8936-207f410a0755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562665d0-08eb-4973-8936-207f410a0755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b41e0f-6697-4777-bad2-01ca0dae1b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:34 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Volume 06b83dae-bd39-4a82-af96-eb272ca71d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b83dae-bd39-4a82-af96-eb272ca71d73', 'volume_size': 1}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1483420768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b83dae-bd39-4a82-af96-eb272ca71d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abbf7596ffc413db22862681b735386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:34Z,use_quota=True,user_id='d8ee84647d8c44149963ad17a1f8ea74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Creating volume 06b83dae-bd39-4a82-af96-eb272ca71d73 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:27:34 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-06b83dae-bd39-4a82-af96-eb272ca71d73 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:34 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-06b83dae-bd39-4a82-af96-eb272ca71d73 1073741824
Apr 29 10:27:34 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-6d0a5c1d-5099-4d7a-b4b0-5b298cacae2e req-99aea91a-b1c7-4bac-9989-8ad65026142d tempest-AttachVolumeTestJSON-1917629784 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5adb26e6-76e7-44a1-8d8e-d1299a87c494', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:27:34 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-6d0a5c1d-5099-4d7a-b4b0-5b298cacae2e req-99aea91a-b1c7-4bac-9989-8ad65026142d tempest-AttachVolumeTestJSON-1917629784 None] attachment_update completed successfully.
Apr 29 10:27:34 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16 -F qcow2" returned: 0 in 0.827s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-77ac831f-8876-4c07-97f5-63565fe86617" released by "_delete_snapshot" :: held 7.382s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-43fe76b4-bd38-4953-88e0-17699ca5b1fa" released by "delete_snapshot" :: held 7.422s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Created reservations ['5bf504f1-b477-452c-b2b2-740f46b866a5', '8456031b-a37e-46ea-90bf-637fe3cf145c', 'c48bee4f-3947-43f3-aede-d9639b66a920', 'fa106ee0-96af-4cb8-98ad-f5b662235111'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:27:34 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Delete snapshot completed successfully.
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-77ac831f-8876-4c07-97f5-63565fe86617-delete_snapshot" released by "delete_snapshot" :: held 7.707s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-da32a002-c689-4eac-81f6-bd611d200f16-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-da32a002-c689-4eac-81f6-bd611d200f16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-quobyte-43fe76b4-bd38-4953-88e0-17699ca5b1fa" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-43fe76b4-bd38-4953-88e0-17699ca5b1fa" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-quobyte-da32a002-c689-4eac-81f6-bd611d200f16" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-da32a002-c689-4eac-81f6-bd611d200f16" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Deleting offline snapshot da32a002-c689-4eac-81f6-bd611d200f16 of volume 43fe76b4-bd38-4953-88e0-17699ca5b1fa {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] snapshot_file for this snap is: volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c347dd3e-3a80-4a2f-bbc0-b71ced058feb]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:35 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-06b83dae-bd39-4a82-af96-eb272ca71d73 1073741824" returned: 0 in 1.091s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:35 devstack sudo[100651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16
Apr 29 10:27:35 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-06b83dae-bd39-4a82-af96-eb272ca71d73 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:35 devstack sudo[100653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-06b83dae-bd39-4a82-af96-eb272ca71d73
Apr 29 10:27:35 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:35 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-06b83dae-bd39-4a82-af96-eb272ca71d73" returned: 0 in 0.636s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b41e0f-6697-4777-bad2-01ca0dae1b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b83dae-bd39-4a82-af96-eb272ca71d73', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f247876-31cd-46d8-a8da-2f8b17766877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:35 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Volume volume-06b83dae-bd39-4a82-af96-eb272ca71d73 (06b83dae-bd39-4a82-af96-eb272ca71d73): created successfully
Apr 29 10:27:35 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f247876-31cd-46d8-a8da-2f8b17766877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Flow 'volume_create_manager' (31fc55e6-197b-4fc8-8a3d-91764c2db04e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16" returned: 0 in 0.820s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:27:35 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-48b3bdaa-67d7-43e6-b1d8-6b2436af20a0 tempest-VolumesNegativeTest-221336152 None] Created volume successfully.
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d090d20e-56e1-40d9-870c-243bbb32b648]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Flow 'volume_create_manager' (d649b206-4a4a-4799-9ec0-1a09ac365b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b9ddd0a-ccaf-4d25-a948-920446e5645a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b9ddd0a-ccaf-4d25-a948-920446e5645a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-429400310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=749a8e10-0e36-46d2-8a58-af5189e127ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f990b0b45444169c4da277cf6719f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:36Z,use_quota=True,user_id='2010c1f3bf194950b230326629bae08b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19369717-efe4-4314-a02d-483735b5c08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19369717-efe4-4314-a02d-483735b5c08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f69e6c-7778-4930-9055-b20ea38462e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f69e6c-7778-4930-9055-b20ea38462e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '749a8e10-0e36-46d2-8a58-af5189e127ac', 'volume_name': 'volume-749a8e10-0e36-46d2-8a58-af5189e127ac', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb29d44d-5d8a-459a-9c25-90b1d0e7e958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:36 devstack sudo[100976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa
Apr 29 10:27:36 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb29d44d-5d8a-459a-9c25-90b1d0e7e958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc10a146-b5fb-4640-8178-10f5525d116f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:36 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Volume 749a8e10-0e36-46d2-8a58-af5189e127ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-749a8e10-0e36-46d2-8a58-af5189e127ac', 'volume_size': 1}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-429400310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=749a8e10-0e36-46d2-8a58-af5189e127ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f990b0b45444169c4da277cf6719f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:36Z,use_quota=True,user_id='2010c1f3bf194950b230326629bae08b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Creating volume 749a8e10-0e36-46d2-8a58-af5189e127ac {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:27:36 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:36 devstack sudo[100978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac 1073741824
Apr 29 10:27:36 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:36 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa" returned: 0 in 0.819s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:36 devstack sudo[100989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16
Apr 29 10:27:36 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:36 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac 1073741824" returned: 0 in 0.866s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:37 devstack sudo[100991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac
Apr 29 10:27:37 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:37 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16" returned: 0 in 0.768s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:37 devstack sudo[100997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16
Apr 29 10:27:37 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:37 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac" returned: 0 in 0.669s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:27:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc10a146-b5fb-4640-8178-10f5525d116f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-749a8e10-0e36-46d2-8a58-af5189e127ac', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6d85ae-4df9-4f18-804e-6cdee47f1ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:37 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Volume volume-749a8e10-0e36-46d2-8a58-af5189e127ac (749a8e10-0e36-46d2-8a58-af5189e127ac): created successfully
Apr 29 10:27:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6d85ae-4df9-4f18-804e-6cdee47f1ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Flow 'volume_create_manager' (d649b206-4a4a-4799-9ec0-1a09ac365b72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:37 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-63126b25-a8b8-4a23-a5b2-a0e143cc286b tempest-VolumesSnapshotTestJSON-1648621122 None] Created volume successfully.
Apr 29 10:27:38 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa.da32a002-c689-4eac-81f6-bd611d200f16" returned: 0 in 0.630s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-da32a002-c689-4eac-81f6-bd611d200f16" released by "_delete_snapshot" :: held 3.173s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-43fe76b4-bd38-4953-88e0-17699ca5b1fa" released by "delete_snapshot" :: held 3.202s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:38 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Created reservations ['1aedff6e-7c17-4ea7-8f79-18b0933b3095', '643815d4-b5ed-42f3-8fca-23301db6f0f5', 'a9c669e8-6c85-41c0-8cca-f9c768400561', '134b6e1f-941f-4cec-b59e-236fdbe86ea6'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:27:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:38 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Delete snapshot completed successfully.
Apr 29 10:27:38 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] Creating offline snapshot 1fa3b6d5-b666-44c4-bbc1-9589e60a134f of volume 749a8e10-0e36-46d2-8a58-af5189e127ac {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:27:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-da32a002-c689-4eac-81f6-bd611d200f16-delete_snapshot" released by "delete_snapshot" :: held 3.438s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Snapshots deleted, issuing volume delete {{(pid=84165) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 29 10:27:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-quobyte-43fe76b4-bd38-4953-88e0-17699ca5b1fa" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-43fe76b4-bd38-4953-88e0-17699ca5b1fa" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:38 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3330ffaa-657c-4017-8438-55531d940f7a]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:38 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84551bd-71cb-4a70-bc53-e068f6dfba23]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:38 devstack sudo[101001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac
Apr 29 10:27:38 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:38 devstack sudo[101002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa
Apr 29 10:27:38 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:39 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac" returned: 0 in 0.758s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:39 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa" returned: 0 in 0.757s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:39 devstack sudo[101011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f 1G
Apr 29 10:27:39 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:39 devstack sudo[101012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa
Apr 29 10:27:39 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:39 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-43fe76b4-bd38-4953-88e0-17699ca5b1fa" returned: 0 in 0.672s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:39 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-43fe76b4-bd38-4953-88e0-17699ca5b1fa" released by "delete_volume" :: held 1.496s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:40 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Created reservations ['c6062964-1b47-484c-8a1f-556465ed8f58', 'f6a401e5-4cb2-4e9a-9910-cdc5b86ef381', '89cc570d-c256-4832-87b5-df474b54a0b2', '40e4e0e7-6ac9-4dd5-ab26-3d22c6578020'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:27:40 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f 1G" returned: 0 in 0.838s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-749a8e10-0e36-46d2-8a58-af5189e127ac -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:40 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:40 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:40 devstack sudo[101020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-749a8e10-0e36-46d2-8a58-af5189e127ac -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f
Apr 29 10:27:40 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:40 devstack sudo[101021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:27:40 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:40 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.615s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:40 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:27:40 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Deleted volume successfully.
Apr 29 10:27:40 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6724a804-e241-4b20-8569-86ca55ac82b5 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-43fe76b4-bd38-4953-88e0-17699ca5b1fa-delete_volume" released by "delete_volume" :: held 13.592s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:40 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-749a8e10-0e36-46d2-8a58-af5189e127ac -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f" returned: 0 in 0.725s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:40 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f is being set with open permissions: ugo+rw
Apr 29 10:27:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:40 devstack sudo[101028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f
Apr 29 10:27:40 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:41 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:27:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Flow 'volume_create_manager' (e6eca1ae-9069-4180-92de-8c6c64d71196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da83f121-950a-46b9-b855-ef747585f257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da83f121-950a-46b9-b855-ef747585f257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-570047453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c5040d9-641c-4199-bd9d-ce597ad958b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522dfb4822614ced9c26ea945a315a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:41Z,use_quota=True,user_id='af713a6b36ee4f34843c18f37819c680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ecfae55-8d56-4820-9054-bd875ad1e2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ecfae55-8d56-4820-9054-bd875ad1e2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab48f59-98be-4685-b85e-894b0769ec95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab48f59-98be-4685-b85e-894b0769ec95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c5040d9-641c-4199-bd9d-ce597ad958b0', 'volume_name': 'volume-9c5040d9-641c-4199-bd9d-ce597ad958b0', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5628f233-cd96-402b-9656-9e0e70f79292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5628f233-cd96-402b-9656-9e0e70f79292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42000ed3-f024-4e42-9e6b-d7a01144f73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:41 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Volume 9c5040d9-641c-4199-bd9d-ce597ad958b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c5040d9-641c-4199-bd9d-ce597ad958b0', 'volume_size': 1}
Apr 29 10:27:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:41 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f" returned: 0 in 0.868s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:41 devstack sudo[101071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.info
Apr 29 10:27:41 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:42 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.info" returned: 0 in 0.666s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:42 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.info is being set with open permissions: ugo+rw
Apr 29 10:27:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:42 devstack sudo[101075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.info
Apr 29 10:27:42 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:43 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.info" returned: 0 in 0.797s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.796s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.656s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-570047453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c5040d9-641c-4199-bd9d-ce597ad958b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522dfb4822614ced9c26ea945a315a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:41Z,use_quota=True,user_id='af713a6b36ee4f34843c18f37819c680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:27:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Creating volume 9c5040d9-641c-4199-bd9d-ce597ad958b0 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:27:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:27:43 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:27:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:43 devstack sudo[101080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 1073741824
Apr 29 10:27:43 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:43 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-49b5d935-fa5c-466d-81be-6b095a458cbc tempest-VolumesSnapshotTestJSON-1648621122 None] Create snapshot completed successfully
Apr 29 10:27:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-1fa3b6d5-b666-44c4-bbc1-9589e60a134f-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-1fa3b6d5-b666-44c4-bbc1-9589e60a134f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-quobyte-749a8e10-0e36-46d2-8a58-af5189e127ac" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-749a8e10-0e36-46d2-8a58-af5189e127ac" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-quobyte-1fa3b6d5-b666-44c4-bbc1-9589e60a134f" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-1fa3b6d5-b666-44c4-bbc1-9589e60a134f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Deleting offline snapshot 1fa3b6d5-b666-44c4-bbc1-9589e60a134f of volume 749a8e10-0e36-46d2-8a58-af5189e127ac {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] snapshot_file for this snap is: volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6068dff3-8036-4b35-b0b2-97bd8c02cbd3]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:44 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:44 devstack sudo[101102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f
Apr 29 10:27:44 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 1073741824" returned: 0 in 1.046s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:44 devstack sudo[101105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0
Apr 29 10:27:44 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:44 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f" returned: 0 in 0.762s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-749a8e10-0e36-46d2-8a58-af5189e127ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[23aa892d-d678-496d-87d9-f4991cdf2ee8]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:44 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0" returned: 0 in 0.632s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42000ed3-f024-4e42-9e6b-d7a01144f73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c5040d9-641c-4199-bd9d-ce597ad958b0', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24c0335-6467-45d8-b447-33f184063497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:45 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Volume volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 (9c5040d9-641c-4199-bd9d-ce597ad958b0): created successfully
Apr 29 10:27:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24c0335-6467-45d8-b447-33f184063497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Flow 'volume_create_manager' (e6eca1ae-9069-4180-92de-8c6c64d71196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:45 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-9ba4c14f-d8a3-4277-8aaf-c4f38c557165 tempest-VolumesDeleteCascade-1536392241 None] Created volume successfully.
Apr 29 10:27:45 devstack sudo[101111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac
Apr 29 10:27:45 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:45 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac" returned: 0 in 0.750s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:45 devstack sudo[101116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f
Apr 29 10:27:45 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] Creating offline snapshot 72fcbca9-7411-42cf-86a0-404e7434d3ee of volume 9c5040d9-641c-4199-bd9d-ce597ad958b0 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:27:45 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7bc653-d155-493c-a83a-b06221952a51]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:46 devstack sudo[101118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0
Apr 29 10:27:46 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:46 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f" returned: 0 in 0.726s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:46 devstack sudo[101123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f
Apr 29 10:27:46 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:46 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0" returned: 0 in 0.790s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:46 devstack sudo[101128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee 1G
Apr 29 10:27:46 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:47 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac.1fa3b6d5-b666-44c4-bbc1-9589e60a134f" returned: 0 in 0.705s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-1fa3b6d5-b666-44c4-bbc1-9589e60a134f" released by "_delete_snapshot" :: held 3.108s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-749a8e10-0e36-46d2-8a58-af5189e127ac" released by "delete_snapshot" :: held 3.136s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:47 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Created reservations ['43aa6082-7d84-4c65-9749-f030e23f2103', '8f1a9e07-2ea9-4720-9708-51a6cf96f177', '2e0d7b38-b491-4377-a8f1-ebce97b46979', 'cf944379-d63e-4ee5-82d2-a8dbce1983d1'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:27:47 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Delete snapshot completed successfully.
Apr 29 10:27:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-89b0f075-7831-46f6-8ae7-a3d6ce3dc177 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-1fa3b6d5-b666-44c4-bbc1-9589e60a134f-delete_snapshot" released by "delete_snapshot" :: held 3.364s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:27:47 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee 1G" returned: 0 in 0.906s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:47 devstack sudo[101142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee
Apr 29 10:27:47 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:48 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee" returned: 0 in 0.750s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:48 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee is being set with open permissions: ugo+rw
Apr 29 10:27:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:48 devstack sudo[101178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee
Apr 29 10:27:48 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:48 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:27:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Flow 'volume_create_manager' (316fdbec-cecf-4991-9492-a4e95f688812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e079402e-8d1f-4a99-b860-0cd56db4e187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e079402e-8d1f-4a99-b860-0cd56db4e187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-577990641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7131ee1f-9f0d-45ca-a3d0-bb59cd61c376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f990b0b45444169c4da277cf6719f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:49Z,use_quota=True,user_id='2010c1f3bf194950b230326629bae08b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3461f88-ab76-470c-9f98-6b17325d4b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3461f88-ab76-470c-9f98-6b17325d4b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfdabad-ae87-4f9c-b041-ff3dca1ec1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfdabad-ae87-4f9c-b041-ff3dca1ec1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7131ee1f-9f0d-45ca-a3d0-bb59cd61c376', 'volume_name': 'volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc7c6dc-8c54-4b2e-a957-2df99f2b17ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc7c6dc-8c54-4b2e-a957-2df99f2b17ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e7dc32-b386-4ea9-82c3-5441f372df02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:49 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Volume 7131ee1f-9f0d-45ca-a3d0-bb59cd61c376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376', 'volume_size': 1}
Apr 29 10:27:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:49 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee" returned: 0 in 1.118s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:49 devstack sudo[101304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.info
Apr 29 10:27:49 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:50 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.info" returned: 0 in 0.727s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:50 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.info is being set with open permissions: ugo+rw
Apr 29 10:27:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:50 devstack sudo[101317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.info
Apr 29 10:27:50 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:51 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.info" returned: 0 in 0.726s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.184s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.035s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-577990641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7131ee1f-9f0d-45ca-a3d0-bb59cd61c376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f990b0b45444169c4da277cf6719f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:49Z,use_quota=True,user_id='2010c1f3bf194950b230326629bae08b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:27:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Creating volume 7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:27:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:27:51 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:27:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:51 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-68bf7eeb-cb17-48c6-941d-af26e206e51c tempest-VolumesDeleteCascade-1536392241 None] Create snapshot completed successfully
Apr 29 10:27:51 devstack sudo[101324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 1073741824
Apr 29 10:27:51 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:52 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 1073741824" returned: 0 in 1.149s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:52 devstack sudo[101690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376
Apr 29 10:27:52 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Flow 'volume_create_manager' (0df4b210-87be-4983-82e1-afbadacd6cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f49f63-60bf-4aa2-99b4-d432a8baf3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f49f63-60bf-4aa2-99b4-d432a8baf3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-965556206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a43488-bbf0-4c5b-b11d-c14ad3d42b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522dfb4822614ced9c26ea945a315a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=72fcbca9-7411-42cf-86a0-404e7434d3ee,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:27:53Z,use_quota=True,user_id='af713a6b36ee4f34843c18f37819c680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f0b96f-6c4a-4b5e-a0d7-392329a159c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f0b96f-6c4a-4b5e-a0d7-392329a159c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486ae3ca-d04a-489a-9d97-dd0527de84d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486ae3ca-d04a-489a-9d97-dd0527de84d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41a43488-bbf0-4c5b-b11d-c14ad3d42b2d', 'volume_name': 'volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d', 'volume_size': 1, 'snapshot_id': '72fcbca9-7411-42cf-86a0-404e7434d3ee'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6528e5de-c483-4222-a1c3-97d353efcd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6528e5de-c483-4222-a1c3-97d353efcd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f5bda0-2520-4f66-8908-4d978f9c22fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:53 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Volume 41a43488-bbf0-4c5b-b11d-c14ad3d42b2d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d', 'volume_size': 1, 'snapshot_id': '72fcbca9-7411-42cf-86a0-404e7434d3ee'}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:53 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376" returned: 0 in 1.244s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] <== create_volume: return (2528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.533s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.200s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-quobyte-72fcbca9-7411-42cf-86a0-404e7434d3ee-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d" by "_create_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e7dc32-b386-4ea9-82c3-5441f372df02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e28689-8944-453f-b1ba-bb63a9aacc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-72fcbca9-7411-42cf-86a0-404e7434d3ee-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Creating volume 41a43488-bbf0-4c5b-b11d-c14ad3d42b2d from snapshot 72fcbca9-7411-42cf-86a0-404e7434d3ee {{(pid=84165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-quobyte-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d" by "_copy_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:27:53 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Volume volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 (7131ee1f-9f0d-45ca-a3d0-bb59cd61c376): created successfully
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e28689-8944-453f-b1ba-bb63a9aacc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Flow 'volume_create_manager' (316fdbec-cecf-4991-9492-a4e95f688812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d" acquired by "_copy_volume_from_snapshot" :: waited 0.072s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] snapshot: 72fcbca9-7411-42cf-86a0-404e7434d3ee, volume: 41a43488-bbf0-4c5b-b11d-c14ad3d42b2d,  {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 10:27:53 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5e1d0981-7d4f-4fef-b2e8-4f6bf75e1557 tempest-VolumesSnapshotTestJSON-1648621122 None] Created volume successfully.
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1665f144-a4e4-48b3-ac58-acdfaa5b312d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:54 devstack sudo[101716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee
Apr 29 10:27:54 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:27:55 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee" returned: 0 in 1.198s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c5040d9-641c-4199-bd9d-ce597ad958b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:27:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 10:27:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Creating direct copy from snapshot {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 10:27:55 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e262180b-e226-457c-b3f2-121c6d864d5c]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:27:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:55 devstack sudo[101757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0
Apr 29 10:27:55 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:27:56 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root
Apr 29 10:27:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0" returned: 0 in 0.914s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:27:56 devstack cinder-volume[84165]: DEBUG cinder.utils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Path /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d not found in is_blk_device check {{(pid=84165) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 10:27:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:27:56 devstack sudo[101763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d
Apr 29 10:27:56 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:02 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d" returned: 0 in 6.538s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:02 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fbebf3-9f55-4888-809c-728509fb7367]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:02 devstack sudo[101777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0
Apr 29 10:28:02 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:03 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0" returned: 0 in 0.938s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:03 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:28:03 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Converted 1024.00 MB image at 156.59 MB/s
Apr 29 10:28:03 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d is being set with open permissions: ugo+rw
Apr 29 10:28:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:03 devstack sudo[101783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d
Apr 29 10:28:03 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:04 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d" returned: 0 in 0.648s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d" released by "_copy_volume_from_snapshot" :: held 10.463s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-72fcbca9-7411-42cf-86a0-404e7434d3ee-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d" released by "_create_volume_from_snapshot" :: held 10.566s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.610s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.423s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:04 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=145,cinder:SELECT=128,cinder:INSERT=26,cinder:DELETE=9 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:28:04 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=132,cinder:SELECT=123,cinder:INSERT=38,cinder:DELETE=12 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:28:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] Creating offline snapshot 95398c94-349a-4997-9dbe-8a80f3093861 of volume 7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:28:04 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5e6081-6db5-44f8-833d-538e89196c6b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f5bda0-2520-4f66-8908-4d978f9c22fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d', 'volume_size': 1, 'snapshot_id': '72fcbca9-7411-42cf-86a0-404e7434d3ee'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4f3066-7ced-4e6a-b0bb-6303be3638b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:04 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Volume volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d (41a43488-bbf0-4c5b-b11d-c14ad3d42b2d): created successfully
Apr 29 10:28:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4f3066-7ced-4e6a-b0bb-6303be3638b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Flow 'volume_create_manager' (0df4b210-87be-4983-82e1-afbadacd6cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:28:04 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-66684911-43c6-49b3-8e84-afb54c31eb80 tempest-VolumesDeleteCascade-1536392241 None] Created volume successfully.
Apr 29 10:28:04 devstack sudo[101787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376
Apr 29 10:28:04 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:05 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376" returned: 0 in 0.809s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:05 devstack sudo[101794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861 1G
Apr 29 10:28:05 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:05 devstack sudo[101796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:28:05 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-9c5040d9-641c-4199-bd9d-ce597ad958b0-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-9c5040d9-641c-4199-bd9d-ce597ad958b0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Performing cascade delete. {{(pid=84165) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-72fcbca9-7411-42cf-86a0-404e7434d3ee-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-72fcbca9-7411-42cf-86a0-404e7434d3ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-quobyte-9c5040d9-641c-4199-bd9d-ce597ad958b0" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-9c5040d9-641c-4199-bd9d-ce597ad958b0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-quobyte-72fcbca9-7411-42cf-86a0-404e7434d3ee" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-72fcbca9-7411-42cf-86a0-404e7434d3ee" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Deleting offline snapshot 72fcbca9-7411-42cf-86a0-404e7434d3ee of volume 9c5040d9-641c-4199-bd9d-ce597ad958b0 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] snapshot_file for this snap is: volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6526ef-393a-4fa8-8b5e-87fbd2f18b14]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:05 devstack sudo[101798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee
Apr 29 10:28:05 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:06 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861 1G" returned: 0 in 1.235s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:06 devstack sudo[101805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861
Apr 29 10:28:06 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:06 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.951s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:28:06 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee" returned: 0 in 1.130s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c5040d9-641c-4199-bd9d-ce597ad958b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:28:06 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7754b9c-6111-4f74-95d2-cec0f12a7cd7]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:07 devstack sudo[101820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0
Apr 29 10:28:07 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:07 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861" returned: 0 in 0.898s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:07 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861 is being set with open permissions: ugo+rw
Apr 29 10:28:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:07 devstack sudo[101826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861
Apr 29 10:28:07 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:07 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0" returned: 0 in 0.855s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:07 devstack sudo[101831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee
Apr 29 10:28:07 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:08 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861" returned: 0 in 0.739s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:08 devstack sudo[101834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.info
Apr 29 10:28:08 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:08 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee" returned: 0 in 0.782s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:08 devstack sudo[101841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee
Apr 29 10:28:08 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:08 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.info" returned: 0 in 0.785s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:08 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.info is being set with open permissions: ugo+rw
Apr 29 10:28:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:08 devstack sudo[101868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.info
Apr 29 10:28:08 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:08 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Acquiring lock "cinder-06b83dae-bd39-4a82-af96-eb272ca71d73-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:08 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Lock "cinder-06b83dae-bd39-4a82-af96-eb272ca71d73-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Acquiring lock "cinder-quobyte-06b83dae-bd39-4a82-af96-eb272ca71d73" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Lock "cinder-quobyte-06b83dae-bd39-4a82-af96-eb272ca71d73" acquired by "delete_volume" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfa9aea-d1a6-4806-81bf-f170f926e010]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-06b83dae-bd39-4a82-af96-eb272ca71d73 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:09 devstack sudo[101871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-06b83dae-bd39-4a82-af96-eb272ca71d73
Apr 29 10:28:09 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:09 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0.72fcbca9-7411-42cf-86a0-404e7434d3ee" returned: 0 in 0.652s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-72fcbca9-7411-42cf-86a0-404e7434d3ee" released by "_delete_snapshot" :: held 3.519s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-9c5040d9-641c-4199-bd9d-ce597ad958b0" released by "delete_snapshot" :: held 3.549s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Created reservations ['e58d438c-923f-48e3-a400-0096a1f152e7', '526698f3-03ff-4947-a306-9312f29c038b', '0cf3b95f-825e-4f7b-9efd-e693b86e53d4', 'ef560dec-4651-47dd-a6d8-96dd9356598d'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:28:09 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Delete snapshot completed successfully.
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-72fcbca9-7411-42cf-86a0-404e7434d3ee-delete_snapshot" released by "delete_snapshot" :: held 3.711s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Snapshots deleted, issuing volume delete {{(pid=84165) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-quobyte-9c5040d9-641c-4199-bd9d-ce597ad958b0" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-9c5040d9-641c-4199-bd9d-ce597ad958b0" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ef08ab-612d-4510-bade-0e567f03fdf0]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:09 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.info" returned: 0 in 0.657s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.251s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:09 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0cb4925e-c7e0-4cb2-8e2c-9dd350bc1a25 tempest-VolumesSnapshotTestJSON-1648621122 None] Create snapshot completed successfully
Apr 29 10:28:09 devstack sudo[101875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0
Apr 29 10:28:09 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:09 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-06b83dae-bd39-4a82-af96-eb272ca71d73" returned: 0 in 0.727s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-06b83dae-bd39-4a82-af96-eb272ca71d73 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:09 devstack sudo[101880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-06b83dae-bd39-4a82-af96-eb272ca71d73
Apr 29 10:28:09 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:10 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0" returned: 0 in 0.767s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:10 devstack sudo[101885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0
Apr 29 10:28:10 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Flow 'volume_create_manager' (15e0cdd4-cc4b-4faa-9394-eb084fac5746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1980b6-4eff-4255-bd7a-d011c228210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1980b6-4eff-4255-bd7a-d011c228210e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-992817367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ab326f-3e90-4f62-bf43-4ba67d610666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f990b0b45444169c4da277cf6719f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:28:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=95398c94-349a-4997-9dbe-8a80f3093861,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:28:10Z,use_quota=True,user_id='2010c1f3bf194950b230326629bae08b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67467102-92df-4ad4-9ab5-62980095565b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:10 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67467102-92df-4ad4-9ab5-62980095565b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d172f44c-6e51-4899-8140-312034edef63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d172f44c-6e51-4899-8140-312034edef63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b0ab326f-3e90-4f62-bf43-4ba67d610666', 'volume_name': 'volume-b0ab326f-3e90-4f62-bf43-4ba67d610666', 'volume_size': 2, 'snapshot_id': '95398c94-349a-4997-9dbe-8a80f3093861'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bb17c7-aeb9-4857-9407-ccc141bddd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bb17c7-aeb9-4857-9407-ccc141bddd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d41d4b3-c718-4dc8-bb83-6ff26476edef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:10 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Volume b0ab326f-3e90-4f62-bf43-4ba67d610666: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b0ab326f-3e90-4f62-bf43-4ba67d610666', 'volume_size': 2, 'snapshot_id': '95398c94-349a-4997-9dbe-8a80f3093861'}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-06b83dae-bd39-4a82-af96-eb272ca71d73" returned: 0 in 0.675s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-quobyte-95398c94-349a-4997-9dbe-8a80f3093861-b0ab326f-3e90-4f62-bf43-4ba67d610666" by "_create_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Lock "cinder-quobyte-06b83dae-bd39-4a82-af96-eb272ca71d73" released by "delete_volume" :: held 1.451s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-95398c94-349a-4997-9dbe-8a80f3093861-b0ab326f-3e90-4f62-bf43-4ba67d610666" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Creating volume b0ab326f-3e90-4f62-bf43-4ba67d610666 from snapshot 95398c94-349a-4997-9dbe-8a80f3093861 {{(pid=84165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-quobyte-b0ab326f-3e90-4f62-bf43-4ba67d610666" by "_copy_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-b0ab326f-3e90-4f62-bf43-4ba67d610666" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] snapshot: 95398c94-349a-4997-9dbe-8a80f3093861, volume: b0ab326f-3e90-4f62-bf43-4ba67d610666,  {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3386a5-3413-4070-9017-09b1c3335fe6]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Created reservations ['7678c27b-2827-4ea4-a5ca-af76ac19a44d', '0aeea45b-06b7-4870-b616-101d8cc59219', 'aa1cf88b-908d-4984-97b0-cd9b57faae62', 'ced16ec7-c6b2-4afa-ba81-2e046c7342d8'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:10 devstack sudo[101889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:28:10 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:10 devstack sudo[101888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861
Apr 29 10:28:10 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:10 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5040d9-641c-4199-bd9d-ce597ad958b0" returned: 0 in 0.647s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-9c5040d9-641c-4199-bd9d-ce597ad958b0" released by "delete_volume" :: held 1.479s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:10 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Created reservations ['8d40a819-b73d-47a3-b40d-8d1ebfb8b979', '5e535888-ef6c-4226-956d-9210e600965a', '1a16ce47-3fe3-4462-814b-e71a8f30ffeb', '8dcb4ae6-1b1d-4100-986b-51903a30ee82'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:11 devstack sudo[101893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:28:11 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "cinder-quobyte-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d" acquired by "delete_volume" :: waited 0.033s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9c44b7-c86b-4108-88e3-0a24fbb86f79]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:11 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.821s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:28:11 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Deleted volume successfully.
Apr 29 10:28:11 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861" returned: 0 in 0.924s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Creating direct copy from snapshot {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3d7af53c-313a-4edb-bbcc-7cb52ce1e7c6 tempest-VolumesNegativeTest-221336152 None] Lock "cinder-06b83dae-bd39-4a82-af96-eb272ca71d73-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3144257b-b0cd-436c-a297-d12164e44135]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:11 devstack sudo[101899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d
Apr 29 10:28:11 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:11 devstack sudo[101900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376
Apr 29 10:28:11 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:11 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.787s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:28:11 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Deleted volume successfully.
Apr 29 10:28:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3cbe7fa1-867c-4f39-b360-52eccc6866b7 tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-9c5040d9-641c-4199-bd9d-ce597ad958b0-delete_volume" released by "delete_volume" :: held 6.274s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:12 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d" returned: 0 in 0.865s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:12 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376" returned: 0 in 0.831s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:12 devstack sudo[101911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d
Apr 29 10:28:12 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:12 devstack cinder-volume[84165]: DEBUG cinder.utils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Path /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b0ab326f-3e90-4f62-bf43-4ba67d610666 not found in is_blk_device check {{(pid=84165) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 10:28:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b0ab326f-3e90-4f62-bf43-4ba67d610666 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:12 devstack sudo[101913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b0ab326f-3e90-4f62-bf43-4ba67d610666
Apr 29 10:28:12 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:13 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d" returned: 0 in 0.800s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:13 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-quobyte-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d" released by "delete_volume" :: held 1.724s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:13 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Created reservations ['696c2d6f-2b72-4824-99bf-a4137598384f', 'cf97c967-fd5b-4007-911d-da82febc51b5', '02b259a6-06d5-4bf5-bc47-89c198462df6', '9a3c85a3-19d5-4e2c-9f0c-a0dfba1e03a1'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:28:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:13 devstack sudo[101921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:28:13 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:14 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.464s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:14 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:28:14 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Deleted volume successfully.
Apr 29 10:28:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-687354ac-61b7-42bd-9d9e-dd00d265fb2d tempest-VolumesDeleteCascade-1536392241 None] Lock "cinder-41a43488-bbf0-4c5b-b11d-c14ad3d42b2d-delete_volume" released by "delete_volume" :: held 3.559s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:19 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b0ab326f-3e90-4f62-bf43-4ba67d610666" returned: 0 in 6.723s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:19 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[30067900-9ed7-446b-b31d-0b504f48cdb1]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:19 devstack sudo[101967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376
Apr 29 10:28:19 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:20 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376" returned: 0 in 1.072s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:20 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b0ab326f-3e90-4f62-bf43-4ba67d610666 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:28:20 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Converted 1024.00 MB image at 152.30 MB/s
Apr 29 10:28:20 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b0ab326f-3e90-4f62-bf43-4ba67d610666 is being set with open permissions: ugo+rw
Apr 29 10:28:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b0ab326f-3e90-4f62-bf43-4ba67d610666 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:20 devstack sudo[101977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b0ab326f-3e90-4f62-bf43-4ba67d610666
Apr 29 10:28:20 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:20 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-87470fd5-464a-4eb8-8b2d-7d1fcb31aefe req-ce29f44c-ac46-4033-bf79-49eaf9d3b471 tempest-AttachVolumeTestJSON-1917629784 None] Terminate volume connection completed successfully.
Apr 29 10:28:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-87470fd5-464a-4eb8-8b2d-7d1fcb31aefe req-ce29f44c-ac46-4033-bf79-49eaf9d3b471 tempest-AttachVolumeTestJSON-1917629784 None] Deleting attachment 5adb26e6-76e7-44a1-8d8e-d1299a87c494. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:28:21 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b0ab326f-3e90-4f62-bf43-4ba67d610666" returned: 0 in 0.819s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-b0ab326f-3e90-4f62-bf43-4ba67d610666" released by "_copy_volume_from_snapshot" :: held 10.494s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-95398c94-349a-4997-9dbe-8a80f3093861-b0ab326f-3e90-4f62-bf43-4ba67d610666" released by "_create_volume_from_snapshot" :: held 10.533s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.560s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d41d4b3-c718-4dc8-bb83-6ff26476edef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0ab326f-3e90-4f62-bf43-4ba67d610666', 'volume_size': 2, 'snapshot_id': '95398c94-349a-4997-9dbe-8a80f3093861'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b06582-01e9-47bc-8b6b-a3df25629337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:21 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Volume volume-b0ab326f-3e90-4f62-bf43-4ba67d610666 (b0ab326f-3e90-4f62-bf43-4ba67d610666): created successfully
Apr 29 10:28:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b06582-01e9-47bc-8b6b-a3df25629337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Flow 'volume_create_manager' (15e0cdd4-cc4b-4faa-9394-eb084fac5746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:28:21 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d9b68c6d-62f8-4ac0-a5a9-2360279d3a26 tempest-VolumesSnapshotTestJSON-1648621122 None] Created volume successfully.
Apr 29 10:28:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-b0ab326f-3e90-4f62-bf43-4ba67d610666-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-b0ab326f-3e90-4f62-bf43-4ba67d610666-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-quobyte-b0ab326f-3e90-4f62-bf43-4ba67d610666" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-b0ab326f-3e90-4f62-bf43-4ba67d610666" acquired by "delete_volume" :: waited 0.024s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b767cba-f947-4c99-a4b1-5904c3c8d1af]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b0ab326f-3e90-4f62-bf43-4ba67d610666 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Flow 'volume_create_manager' (154a0b5a-a698-4894-a471-54fa293276d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd45680a-8509-4e33-9e45-1dd392abb14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:22 devstack sudo[101994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b0ab326f-3e90-4f62-bf43-4ba67d610666
Apr 29 10:28:22 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd45680a-8509-4e33-9e45-1dd392abb14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1299285522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ebc214-504f-4ad1-a1fc-dd998520e5a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a665715feb4218aa33db1ab054cd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:28:22Z,use_quota=True,user_id='73403f4565334b0db5325163353df2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e178ee6e-d1ea-4add-9d7d-b9f58fd8574f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e178ee6e-d1ea-4add-9d7d-b9f58fd8574f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0499b4c8-7718-4a1a-9654-f2b1977da874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0499b4c8-7718-4a1a-9654-f2b1977da874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ebc214-504f-4ad1-a1fc-dd998520e5a1', 'volume_name': 'volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683afb2e-d8c0-45e7-9878-b6627bed00d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683afb2e-d8c0-45e7-9878-b6627bed00d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0a50eb-289a-4208-8566-763dd2f77780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:22 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Volume d2ebc214-504f-4ad1-a1fc-dd998520e5a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1', 'volume_size': 1}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1299285522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ebc214-504f-4ad1-a1fc-dd998520e5a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a665715feb4218aa33db1ab054cd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:28:22Z,use_quota=True,user_id='73403f4565334b0db5325163353df2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Creating volume d2ebc214-504f-4ad1-a1fc-dd998520e5a1 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:28:22 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:28:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:22 devstack sudo[101996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1 1073741824
Apr 29 10:28:22 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:23 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b0ab326f-3e90-4f62-bf43-4ba67d610666" returned: 0 in 1.010s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b0ab326f-3e90-4f62-bf43-4ba67d610666 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:23 devstack sudo[102006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b0ab326f-3e90-4f62-bf43-4ba67d610666
Apr 29 10:28:23 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:23 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1 1073741824" returned: 0 in 1.203s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:23 devstack sudo[102045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1
Apr 29 10:28:23 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:23 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-b0ab326f-3e90-4f62-bf43-4ba67d610666" returned: 0 in 0.784s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-b0ab326f-3e90-4f62-bf43-4ba67d610666" released by "delete_volume" :: held 1.862s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:23 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Created reservations ['67944e61-9c74-477f-9c99-32a7a29e73a9', '00c02f07-2ee1-4e2e-a596-f81aa0e0879d', 'e891fac6-b765-44dc-88c9-de2b31ac8338', '99afd0a3-f4e3-4a4c-b620-f259172f1329'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:28:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:24 devstack sudo[102049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:28:24 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:24 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1" returned: 0 in 0.641s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0a50eb-289a-4208-8566-763dd2f77780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36eafebc-4376-45f2-a162-3b080e07d427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:24 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Volume volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1 (d2ebc214-504f-4ad1-a1fc-dd998520e5a1): created successfully
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36eafebc-4376-45f2-a162-3b080e07d427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Flow 'volume_create_manager' (154a0b5a-a698-4894-a471-54fa293276d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-95398c94-349a-4997-9dbe-8a80f3093861-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:24 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-411eb5c7-99ea-4ee0-abf4-8fca4dbbfae8 tempest-VolumesTransfersV357Test-1913256483 None] Created volume successfully.
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-95398c94-349a-4997-9dbe-8a80f3093861-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-quobyte-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-quobyte-95398c94-349a-4997-9dbe-8a80f3093861" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-95398c94-349a-4997-9dbe-8a80f3093861" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Deleting offline snapshot 95398c94-349a-4997-9dbe-8a80f3093861 of volume 7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] snapshot_file for this snap is: volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca46e9d-05fe-4b56-9dc6-9dcf7df8dfc5]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:24 devstack sudo[102052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861
Apr 29 10:28:24 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:24 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.770s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:28:24 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Deleted volume successfully.
Apr 29 10:28:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3be4d794-45ca-469f-8dbd-f87f0faf229f tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-b0ab326f-3e90-4f62-bf43-4ba67d610666-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:25 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861" returned: 0 in 0.925s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:28:25 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b7b7da-e2a4-4950-830c-daacd7cd9eec]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:25 devstack sudo[102059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376
Apr 29 10:28:25 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:26 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3f6f3a10-1802-4adc-a090-9247e49207fa tempest-VolumesTransfersV357Test-1300815164 None] Transfer volume completed successfully.
Apr 29 10:28:26 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376" returned: 0 in 0.847s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:26 devstack sudo[102065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861
Apr 29 10:28:26 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:27 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861" returned: 0 in 0.960s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:27 devstack sudo[102073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861
Apr 29 10:28:27 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Acquiring lock "cinder-d2ebc214-504f-4ad1-a1fc-dd998520e5a1-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Lock "cinder-d2ebc214-504f-4ad1-a1fc-dd998520e5a1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Acquiring lock "cinder-quobyte-d2ebc214-504f-4ad1-a1fc-dd998520e5a1" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Lock "cinder-quobyte-d2ebc214-504f-4ad1-a1fc-dd998520e5a1" acquired by "delete_volume" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:27 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7f8d3f-9ed5-4b9b-9c61-b09eee7acbc7]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:27 devstack sudo[102075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1
Apr 29 10:28:27 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:28 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376.95398c94-349a-4997-9dbe-8a80f3093861" returned: 0 in 0.791s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-95398c94-349a-4997-9dbe-8a80f3093861" released by "_delete_snapshot" :: held 3.671s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376" released by "delete_snapshot" :: held 3.720s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:28 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Created reservations ['00f41b49-af64-41d4-b233-7c5d9320602a', '400da936-c828-47c7-8a47-122533cc96a1', '095bbfd9-7ca8-4d36-a584-9b779d7cd145', '0131766b-f437-414f-a856-53568004798b'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:28:28 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Delete snapshot completed successfully.
Apr 29 10:28:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f711ae54-6c3c-4b3c-bc21-6fc8eed9fee4 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-95398c94-349a-4997-9dbe-8a80f3093861-delete_snapshot" released by "delete_snapshot" :: held 3.879s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:28 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1" returned: 0 in 0.769s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:28 devstack sudo[102081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1
Apr 29 10:28:28 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-quobyte-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376" acquired by "delete_volume" :: waited 0.032s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:28 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ec86a8-df4f-4a12-ad92-818d5af41722]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:29 devstack sudo[102083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376
Apr 29 10:28:29 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:29 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d2ebc214-504f-4ad1-a1fc-dd998520e5a1" returned: 0 in 0.806s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Lock "cinder-quobyte-d2ebc214-504f-4ad1-a1fc-dd998520e5a1" released by "delete_volume" :: held 1.651s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:29 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Created reservations ['082f4822-cb2f-4db6-b5f3-f3a334800a5d', '16b621da-a3ba-444e-8aa7-63b625629050', 'fbeb94c7-5cbd-4350-99a2-b8e5d64d6c5b', '7c4e4397-0462-4297-8b19-784eb274498a'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:28:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:29 devstack sudo[102086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:28:29 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:30 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376" returned: 0 in 1.206s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:30 devstack sudo[102092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376
Apr 29 10:28:30 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:30 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.964s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:28:30 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Deleted volume successfully.
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5f933eac-cf3d-49fa-b5ca-d82244ea6072 tempest-VolumesTransfersV357Test-1379471389 None] Lock "cinder-d2ebc214-504f-4ad1-a1fc-dd998520e5a1-delete_volume" released by "delete_volume" :: held 2.933s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Flow 'volume_create_manager' (08f003f3-2dea-42f2-892b-0fdd45b1ee3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661fa189-9f93-4d08-80e6-4a52d9b60f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661fa189-9f93-4d08-80e6-4a52d9b60f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1140038950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0079c0-5d7c-4a01-8987-5e4ba232277f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a665715feb4218aa33db1ab054cd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:28:31Z,use_quota=True,user_id='73403f4565334b0db5325163353df2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3835615e-31c6-44b4-8d8f-b2b3ac1f0802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3835615e-31c6-44b4-8d8f-b2b3ac1f0802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50754df2-ba08-449a-9b2d-7ae3c9858489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50754df2-ba08-449a-9b2d-7ae3c9858489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f0079c0-5d7c-4a01-8987-5e4ba232277f', 'volume_name': 'volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698b94ba-b33f-4764-bb66-cb30f590965c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698b94ba-b33f-4764-bb66-cb30f590965c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa66412b-09e3-4fee-9fcd-be94e1585527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:30 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Volume 7f0079c0-5d7c-4a01-8987-5e4ba232277f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f', 'volume_size': 1}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1140038950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0079c0-5d7c-4a01-8987-5e4ba232277f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a665715feb4218aa33db1ab054cd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:28:31Z,use_quota=True,user_id='73403f4565334b0db5325163353df2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Creating volume 7f0079c0-5d7c-4a01-8987-5e4ba232277f {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:28:30 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:30 devstack sudo[102094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f 1073741824
Apr 29 10:28:30 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:30 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376" returned: 0 in 0.800s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376" released by "delete_volume" :: held 2.098s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:31 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Created reservations ['8d653dc3-b2a6-4c34-9027-9a0ea62ac1f2', '2516a6aa-9aa1-42c8-a8e2-d533ac95ce7d', 'c6d12fa9-ceb8-42a8-8938-a1e7742e5587', '8e568112-2efa-4968-b3c0-61d30e4fc424'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:28:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:31 devstack sudo[102097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:28:31 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:31 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:31 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.763s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:31 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:28:31 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Deleted volume successfully.
Apr 29 10:28:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f 1073741824" returned: 0 in 1.150s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0dd9c4ae-93d0-46e2-a13e-33022a38004a tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-7131ee1f-9f0d-45ca-a3d0-bb59cd61c376-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:31 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:28:32 devstack sudo[102114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f
Apr 29 10:28:32 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Flow 'volume_create_manager' (1baaf44d-7ffd-472a-a0ba-1bf86d53a758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541691e6-d0be-461d-9307-4bcd267334a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541691e6-d0be-461d-9307-4bcd267334a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-215350097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9fcc1e-0282-47e5-b607-eeeb9340ba34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f990b0b45444169c4da277cf6719f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:28:32Z,use_quota=True,user_id='2010c1f3bf194950b230326629bae08b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3c3f46-477e-4ca9-b578-e5a18c8fb4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3c3f46-477e-4ca9-b578-e5a18c8fb4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2907e631-95ba-4c15-801a-d2b3eab94eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2907e631-95ba-4c15-801a-d2b3eab94eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b9fcc1e-0282-47e5-b607-eeeb9340ba34', 'volume_name': 'volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe64c56-3cea-4208-917e-a7b03416a60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe64c56-3cea-4208-917e-a7b03416a60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b86ee4-9ef5-4702-96db-a581169c6dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:32 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Volume 5b9fcc1e-0282-47e5-b607-eeeb9340ba34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34', 'volume_size': 1}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:32 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f" returned: 0 in 0.680s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.566s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-215350097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9fcc1e-0282-47e5-b607-eeeb9340ba34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f990b0b45444169c4da277cf6719f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:28:32Z,use_quota=True,user_id='2010c1f3bf194950b230326629bae08b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Creating volume 5b9fcc1e-0282-47e5-b607-eeeb9340ba34 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:28:32 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:32 devstack sudo[102123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 1073741824
Apr 29 10:28:32 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa66412b-09e3-4fee-9fcd-be94e1585527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66eb9af4-8b44-4522-9b0d-7e611c08bebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:32 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Volume volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f (7f0079c0-5d7c-4a01-8987-5e4ba232277f): created successfully
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66eb9af4-8b44-4522-9b0d-7e611c08bebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:32 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Flow 'volume_create_manager' (08f003f3-2dea-42f2-892b-0fdd45b1ee3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:28:32 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-128b2d2a-2ea0-4914-94c9-eed1df75826a tempest-VolumesTransfersV357Test-1913256483 None] Created volume successfully.
Apr 29 10:28:33 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 1073741824" returned: 0 in 1.201s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:34 devstack sudo[102189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34
Apr 29 10:28:34 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Acquiring lock "cinder-7f0079c0-5d7c-4a01-8987-5e4ba232277f-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Lock "cinder-7f0079c0-5d7c-4a01-8987-5e4ba232277f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Acquiring lock "cinder-quobyte-7f0079c0-5d7c-4a01-8987-5e4ba232277f" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Lock "cinder-quobyte-7f0079c0-5d7c-4a01-8987-5e4ba232277f" acquired by "delete_volume" :: waited 0.041s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:34 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e47d6f9-5361-4711-9266-81e58d1ea5d1]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:34 devstack sudo[102198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f
Apr 29 10:28:34 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:35 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34" returned: 0 in 1.171s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] <== create_volume: return (2475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:28:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.478s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b86ee4-9ef5-4702-96db-a581169c6dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64320dfc-bea4-44af-a4de-8dbcc45d9f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:35 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Volume volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 (5b9fcc1e-0282-47e5-b607-eeeb9340ba34): created successfully
Apr 29 10:28:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64320dfc-bea4-44af-a4de-8dbcc45d9f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Flow 'volume_create_manager' (1baaf44d-7ffd-472a-a0ba-1bf86d53a758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:28:35 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-b37ff1dd-513f-4ae8-9f98-89f44c6fd1ae tempest-VolumesSnapshotTestJSON-1648621122 None] Created volume successfully.
Apr 29 10:28:35 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f" returned: 0 in 0.934s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:35 devstack sudo[102206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f
Apr 29 10:28:35 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:36 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7f0079c0-5d7c-4a01-8987-5e4ba232277f" returned: 0 in 0.924s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:36 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Lock "cinder-quobyte-7f0079c0-5d7c-4a01-8987-5e4ba232277f" released by "delete_volume" :: held 1.967s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:36 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Created reservations ['a97448b5-6955-45b8-8f05-531ffba3a78d', '6d90974c-f8c6-4d8a-a1d0-b024fd8f3b27', '24046665-ebaa-489c-85f6-6fd4207d455d', '69da6446-c8c8-4231-975c-def8988e205e'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:28:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:36 devstack sudo[102209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:28:36 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] Creating offline snapshot 39dccfd0-8f91-4541-bf78-da12a28b8672 of volume 5b9fcc1e-0282-47e5-b607-eeeb9340ba34 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:28:36 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5409343-5a1d-4c54-8494-245f18797e2e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:37 devstack sudo[102211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34
Apr 29 10:28:37 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:37 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.853s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:37 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:28:37 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Deleted volume successfully.
Apr 29 10:28:37 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e7309793-fbee-4628-bb29-63d6eccb318c tempest-VolumesTransfersV357Test-1379471389 None] Lock "cinder-7f0079c0-5d7c-4a01-8987-5e4ba232277f-delete_volume" released by "delete_volume" :: held 3.232s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:38 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34" returned: 0 in 1.459s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:38 devstack sudo[102218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672 1G
Apr 29 10:28:38 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:39 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672 1G" returned: 0 in 1.266s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:39 devstack sudo[102224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672
Apr 29 10:28:39 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:40 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672" returned: 0 in 0.887s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:40 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672 is being set with open permissions: ugo+rw
Apr 29 10:28:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:40 devstack sudo[102230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672
Apr 29 10:28:40 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:41 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672" returned: 0 in 0.918s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:41 devstack sudo[102233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.info
Apr 29 10:28:41 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:42 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.info" returned: 0 in 0.890s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:42 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.info is being set with open permissions: ugo+rw
Apr 29 10:28:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:42 devstack sudo[102236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.info
Apr 29 10:28:42 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:43 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.info" returned: 0 in 0.786s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.353s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:43 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-4eef5e6a-5dc2-4b79-a81a-647f0272d1ff tempest-VolumesSnapshotTestJSON-1648621122 None] Create snapshot completed successfully
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Flow 'volume_create_manager' (0e761dc4-fa2e-4699-924f-0fc2b4a93a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9801be-0c3d-4439-9992-4cded3bc6e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9801be-0c3d-4439-9992-4cded3bc6e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1875201514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17de4616-90bd-4743-bdc3-e0c843a8a823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f990b0b45444169c4da277cf6719f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=39dccfd0-8f91-4541-bf78-da12a28b8672,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:28:45Z,use_quota=True,user_id='2010c1f3bf194950b230326629bae08b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f25c2a-e0a1-4a67-a198-1bf34d7e5335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f25c2a-e0a1-4a67-a198-1bf34d7e5335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fb7f8a-bbe2-4a94-a877-45f967863f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fb7f8a-bbe2-4a94-a877-45f967863f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '17de4616-90bd-4743-bdc3-e0c843a8a823', 'volume_name': 'volume-17de4616-90bd-4743-bdc3-e0c843a8a823', 'volume_size': 1, 'snapshot_id': '39dccfd0-8f91-4541-bf78-da12a28b8672'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b053956a-4624-4b69-94b0-a4fbd12f61cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b053956a-4624-4b69-94b0-a4fbd12f61cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c82a6c-226c-4e55-8a4b-aaf622373ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:45 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Volume 17de4616-90bd-4743-bdc3-e0c843a8a823: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-17de4616-90bd-4743-bdc3-e0c843a8a823', 'volume_size': 1, 'snapshot_id': '39dccfd0-8f91-4541-bf78-da12a28b8672'}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-quobyte-39dccfd0-8f91-4541-bf78-da12a28b8672-17de4616-90bd-4743-bdc3-e0c843a8a823" by "_create_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-39dccfd0-8f91-4541-bf78-da12a28b8672-17de4616-90bd-4743-bdc3-e0c843a8a823" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Creating volume 17de4616-90bd-4743-bdc3-e0c843a8a823 from snapshot 39dccfd0-8f91-4541-bf78-da12a28b8672 {{(pid=84165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-quobyte-17de4616-90bd-4743-bdc3-e0c843a8a823" by "_copy_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-17de4616-90bd-4743-bdc3-e0c843a8a823" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] snapshot: 39dccfd0-8f91-4541-bf78-da12a28b8672, volume: 17de4616-90bd-4743-bdc3-e0c843a8a823,  {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e0b4a9-24e7-414e-b027-c9788501f8a4]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:45 devstack sudo[102240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672
Apr 29 10:28:45 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:46 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672" returned: 0 in 0.884s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:28:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 10:28:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Creating direct copy from snapshot {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 10:28:46 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[037d202e-6be3-44c4-9188-d67263786ef7]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:46 devstack sudo[102245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34
Apr 29 10:28:46 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:47 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:28:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Flow 'volume_create_manager' (80d51b2c-737f-4545-a656-b2b117c3774b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:28:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5655da08-ad30-4c94-99ec-6e5fe5cccdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5655da08-ad30-4c94-99ec-6e5fe5cccdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2136550496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c5bd59a-6725-419d-807b-63cbd9c3437e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dada545e55448ec8ace70d280682f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:28:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:28:47Z,use_quota=True,user_id='7a97f38c62874ae48495d26a47a51af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2d537b-d013-4e31-b527-ecd74d40bcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2d537b-d013-4e31-b527-ecd74d40bcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331c8e38-2030-4550-996a-0bc68d32b223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331c8e38-2030-4550-996a-0bc68d32b223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c5bd59a-6725-419d-807b-63cbd9c3437e', 'volume_name': 'volume-9c5bd59a-6725-419d-807b-63cbd9c3437e', 'volume_size': 2}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e581dd9e-1964-4656-9c1d-96cee567abc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e581dd9e-1964-4656-9c1d-96cee567abc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be25006a-5791-41c6-9257-3a15ec278f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:47 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Volume 9c5bd59a-6725-419d-807b-63cbd9c3437e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c5bd59a-6725-419d-807b-63cbd9c3437e', 'volume_size': 2}
Apr 29 10:28:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:47 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34" returned: 0 in 1.044s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:47 devstack cinder-volume[84165]: DEBUG cinder.utils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Path /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17de4616-90bd-4743-bdc3-e0c843a8a823 not found in is_blk_device check {{(pid=84165) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 10:28:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17de4616-90bd-4743-bdc3-e0c843a8a823 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:47 devstack sudo[102254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17de4616-90bd-4743-bdc3-e0c843a8a823
Apr 29 10:28:47 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:52 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17de4616-90bd-4743-bdc3-e0c843a8a823" returned: 0 in 5.321s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:52 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[251de5e5-7d78-4f0e-837d-698398a3caac]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:52 devstack sudo[102269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34
Apr 29 10:28:52 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:53 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34" returned: 0 in 0.934s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:53 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17de4616-90bd-4743-bdc3-e0c843a8a823 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:28:53 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Converted 1024.00 MB image at 192.38 MB/s
Apr 29 10:28:53 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17de4616-90bd-4743-bdc3-e0c843a8a823 is being set with open permissions: ugo+rw
Apr 29 10:28:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17de4616-90bd-4743-bdc3-e0c843a8a823 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:53 devstack sudo[102275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17de4616-90bd-4743-bdc3-e0c843a8a823
Apr 29 10:28:53 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:54 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17de4616-90bd-4743-bdc3-e0c843a8a823" returned: 0 in 0.599s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-17de4616-90bd-4743-bdc3-e0c843a8a823" released by "_copy_volume_from_snapshot" :: held 8.898s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-39dccfd0-8f91-4541-bf78-da12a28b8672-17de4616-90bd-4743-bdc3-e0c843a8a823" released by "_create_volume_from_snapshot" :: held 8.940s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.967s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.290s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2136550496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c5bd59a-6725-419d-807b-63cbd9c3437e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dada545e55448ec8ace70d280682f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:28:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:28:47Z,use_quota=True,user_id='7a97f38c62874ae48495d26a47a51af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Creating volume 9c5bd59a-6725-419d-807b-63cbd9c3437e {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:28:54 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5bd59a-6725-419d-807b-63cbd9c3437e 2147483648 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:54 devstack sudo[102278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5bd59a-6725-419d-807b-63cbd9c3437e 2147483648
Apr 29 10:28:54 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c82a6c-226c-4e55-8a4b-aaf622373ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17de4616-90bd-4743-bdc3-e0c843a8a823', 'volume_size': 1, 'snapshot_id': '39dccfd0-8f91-4541-bf78-da12a28b8672'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87da04c1-2d3f-4795-9718-8720e63bd208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:54 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Volume volume-17de4616-90bd-4743-bdc3-e0c843a8a823 (17de4616-90bd-4743-bdc3-e0c843a8a823): created successfully
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87da04c1-2d3f-4795-9718-8720e63bd208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:54 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Flow 'volume_create_manager' (0e761dc4-fa2e-4699-924f-0fc2b4a93a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:28:54 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-36b1fc87-ea23-45d6-9ebf-893ee625e2c0 tempest-VolumesSnapshotTestJSON-1648621122 None] Created volume successfully.
Apr 29 10:28:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-17de4616-90bd-4743-bdc3-e0c843a8a823-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:55 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5bd59a-6725-419d-807b-63cbd9c3437e 2147483648" returned: 0 in 0.911s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-17de4616-90bd-4743-bdc3-e0c843a8a823-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5bd59a-6725-419d-807b-63cbd9c3437e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:55 devstack sudo[102284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5bd59a-6725-419d-807b-63cbd9c3437e
Apr 29 10:28:55 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-quobyte-17de4616-90bd-4743-bdc3-e0c843a8a823" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-17de4616-90bd-4743-bdc3-e0c843a8a823" acquired by "delete_volume" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:55 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[21350a20-710f-4cc4-b48b-b1e2d48b505b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17de4616-90bd-4743-bdc3-e0c843a8a823 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:55 devstack sudo[102286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17de4616-90bd-4743-bdc3-e0c843a8a823
Apr 29 10:28:55 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:55 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5bd59a-6725-419d-807b-63cbd9c3437e" returned: 0 in 0.602s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:28:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be25006a-5791-41c6-9257-3a15ec278f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c5bd59a-6725-419d-807b-63cbd9c3437e', 'volume_size': 2}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e72d2d8-df62-4219-b308-797c291c85f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:28:56 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Volume volume-9c5bd59a-6725-419d-807b-63cbd9c3437e (9c5bd59a-6725-419d-807b-63cbd9c3437e): created successfully
Apr 29 10:28:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e72d2d8-df62-4219-b308-797c291c85f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:28:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Flow 'volume_create_manager' (80d51b2c-737f-4545-a656-b2b117c3774b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:28:56 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-334fc90f-012e-456c-9827-35f962023584 tempest-VolumesCloneNegativeTest-1220451738 None] Created volume successfully.
Apr 29 10:28:56 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17de4616-90bd-4743-bdc3-e0c843a8a823" returned: 0 in 0.733s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17de4616-90bd-4743-bdc3-e0c843a8a823 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:56 devstack sudo[102292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17de4616-90bd-4743-bdc3-e0c843a8a823
Apr 29 10:28:56 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:56 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-17de4616-90bd-4743-bdc3-e0c843a8a823" returned: 0 in 0.630s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-17de4616-90bd-4743-bdc3-e0c843a8a823" released by "delete_volume" :: held 1.417s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:56 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Created reservations ['fc796c60-ce27-4cf1-abc5-f6ca50503664', '9fcdbe3b-9b12-4be2-98ef-a110ca53e28a', '203c39ca-5e1f-4798-a381-e09d7ea0383d', '46b56f3d-12b2-45f7-923f-b5fa43665cb3'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:57 devstack sudo[102295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:28:57 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Acquiring lock "cinder-9c5bd59a-6725-419d-807b-63cbd9c3437e-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Lock "cinder-9c5bd59a-6725-419d-807b-63cbd9c3437e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Acquiring lock "cinder-quobyte-9c5bd59a-6725-419d-807b-63cbd9c3437e" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Lock "cinder-quobyte-9c5bd59a-6725-419d-807b-63cbd9c3437e" acquired by "delete_volume" :: waited 0.030s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aa77d2-b8a4-4091-8ab7-e7b1fe81ad1f]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5bd59a-6725-419d-807b-63cbd9c3437e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:57 devstack sudo[102297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5bd59a-6725-419d-807b-63cbd9c3437e
Apr 29 10:28:57 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-39dccfd0-8f91-4541-bf78-da12a28b8672-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-39dccfd0-8f91-4541-bf78-da12a28b8672-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-quobyte-5b9fcc1e-0282-47e5-b607-eeeb9340ba34" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-5b9fcc1e-0282-47e5-b607-eeeb9340ba34" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-quobyte-39dccfd0-8f91-4541-bf78-da12a28b8672" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-39dccfd0-8f91-4541-bf78-da12a28b8672" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Deleting offline snapshot 39dccfd0-8f91-4541-bf78-da12a28b8672 of volume 5b9fcc1e-0282-47e5-b607-eeeb9340ba34 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] snapshot_file for this snap is: volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2605a8-dc69-4cfb-92ca-0bd7e34e65de]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:58 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:58 devstack sudo[102301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672
Apr 29 10:28:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.057s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:58 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:58 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:28:58 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Deleted volume successfully.
Apr 29 10:28:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4450383b-3a7d-4589-b496-e8b16d40c8d8 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-17de4616-90bd-4743-bdc3-e0c843a8a823-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:58 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5bd59a-6725-419d-807b-63cbd9c3437e" returned: 0 in 1.022s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5bd59a-6725-419d-807b-63cbd9c3437e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:58 devstack sudo[102307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5bd59a-6725-419d-807b-63cbd9c3437e
Apr 29 10:28:58 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:59 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672" returned: 0 in 1.146s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:28:59 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9361ad47-885e-433f-94b0-66bf5c03467c]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:28:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:59 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root
Apr 29 10:28:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9c5bd59a-6725-419d-807b-63cbd9c3437e" returned: 0 in 0.783s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:28:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Lock "cinder-quobyte-9c5bd59a-6725-419d-807b-63cbd9c3437e" released by "delete_volume" :: held 1.873s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:28:59 devstack sudo[102322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34
Apr 29 10:28:59 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:28:59 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Created reservations ['e3d04f68-4ddf-4e03-aa69-edcb9dbf809d', '020dfb09-4665-48ab-9a4e-3154411efa92', 'fe5035ca-b0a7-461a-a9f0-a1ef169a0204', 'c84879f3-caf6-420a-a3e9-068e2eae86e9'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:28:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:28:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:28:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:28:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:28:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:28:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:28:59 devstack sudo[102365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:28:59 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:00 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.956s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:00 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:29:00 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Deleted volume successfully.
Apr 29 10:29:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fba67d12-976b-4fb4-8ac9-57a67cafdc81 tempest-VolumesCloneNegativeTest-1220451738 None] Lock "cinder-9c5bd59a-6725-419d-807b-63cbd9c3437e-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:00 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34" returned: 0 in 1.471s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:00 devstack sudo[102378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672
Apr 29 10:29:00 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:01 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672" returned: 0 in 0.811s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:01 devstack sudo[102384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672
Apr 29 10:29:01 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:02 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34.39dccfd0-8f91-4541-bf78-da12a28b8672" returned: 0 in 0.889s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-39dccfd0-8f91-4541-bf78-da12a28b8672" released by "_delete_snapshot" :: held 4.474s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-5b9fcc1e-0282-47e5-b607-eeeb9340ba34" released by "delete_snapshot" :: held 4.516s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:02 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Created reservations ['b6106c8e-473e-4af2-a08a-0e60f82f2d21', 'd7f19d9d-0553-49e8-8f88-d38df8dd7634', 'a0194f51-31d6-43f7-928b-a8df00916769', 'e1b91772-c063-4b61-8dd2-ed6bf88db0c5'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:29:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Delete snapshot completed successfully.
Apr 29 10:29:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fee11fd9-8cab-43e7-abe7-6f358a8dce84 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-39dccfd0-8f91-4541-bf78-da12a28b8672-delete_snapshot" released by "delete_snapshot" :: held 4.660s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-5b9fcc1e-0282-47e5-b607-eeeb9340ba34-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-5b9fcc1e-0282-47e5-b607-eeeb9340ba34-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-quobyte-5b9fcc1e-0282-47e5-b607-eeeb9340ba34" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-5b9fcc1e-0282-47e5-b607-eeeb9340ba34" acquired by "delete_volume" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a30b99-8471-4d83-8607-4d1239d7f0a2]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Flow 'volume_create_manager' (71f0bd18-e7f4-4c17-bd28-efd89f62b163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40675130-be5d-48c5-9677-42e243c0dab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40675130-be5d-48c5-9677-42e243c0dab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-565947898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1dfb63-9d47-4798-81a3-711dabe2dce5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf7a660022146e3a2f17e6b6682815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:03Z,use_quota=True,user_id='da25d8364f934fa8872aa3701b6424c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86223c1b-a2ec-4de1-8278-21597fd1dd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86223c1b-a2ec-4de1-8278-21597fd1dd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1ede54-b0d8-41d6-ad7c-d642c155de69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:03 devstack sudo[102393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34
Apr 29 10:29:03 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1ede54-b0d8-41d6-ad7c-d642c155de69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c1dfb63-9d47-4798-81a3-711dabe2dce5', 'volume_name': 'volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9543aff7-4582-4e8d-8018-c10fc6c11353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9543aff7-4582-4e8d-8018-c10fc6c11353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cad2ba1-7612-476b-957e-374438fa7a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:03 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Volume 7c1dfb63-9d47-4798-81a3-711dabe2dce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5', 'volume_size': 1}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-565947898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1dfb63-9d47-4798-81a3-711dabe2dce5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf7a660022146e3a2f17e6b6682815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:03Z,use_quota=True,user_id='da25d8364f934fa8872aa3701b6424c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Creating volume 7c1dfb63-9d47-4798-81a3-711dabe2dce5 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:29:03 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:29:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:03 devstack sudo[102396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5 1073741824
Apr 29 10:29:03 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:04 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34" returned: 0 in 0.798s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:04 devstack sudo[102404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34
Apr 29 10:29:04 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:04 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5 1073741824" returned: 0 in 0.816s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:04 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=113,cinder:DELETE=10,cinder:SELECT=87,cinder:INSERT=27 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:29:04 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=107,cinder:SELECT=83,cinder:INSERT=27,cinder:DELETE=8 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:29:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:04 devstack sudo[102406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5
Apr 29 10:29:04 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:04 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5b9fcc1e-0282-47e5-b607-eeeb9340ba34" returned: 0 in 0.638s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-5b9fcc1e-0282-47e5-b607-eeeb9340ba34" released by "delete_volume" :: held 1.530s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:04 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Created reservations ['7c85b98b-b0ea-495a-8022-deb918dd5ac1', 'c3749b35-2f01-45e9-9dcf-b177fa494536', 'f9d3fc53-75b6-41a8-9093-a9feb8641ec9', '3f6b221f-c1af-40bb-a0c6-f0016b793a7b'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:29:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:05 devstack sudo[102411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:29:05 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:05 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5" returned: 0 in 0.828s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cad2ba1-7612-476b-957e-374438fa7a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d469eb58-a055-4a0e-848c-f5aae32e580a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:05 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Volume volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5 (7c1dfb63-9d47-4798-81a3-711dabe2dce5): created successfully
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d469eb58-a055-4a0e-848c-f5aae32e580a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Flow 'volume_create_manager' (71f0bd18-e7f4-4c17-bd28-efd89f62b163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:05 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8a238cbd-df04-44a5-aa38-b95a78bc62b6 tempest-VolumesGetTest-350006876 None] Created volume successfully.
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:05 devstack sudo[102457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:29:05 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-749a8e10-0e36-46d2-8a58-af5189e127ac-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-749a8e10-0e36-46d2-8a58-af5189e127ac-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "cinder-quobyte-749a8e10-0e36-46d2-8a58-af5189e127ac" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-749a8e10-0e36-46d2-8a58-af5189e127ac" acquired by "delete_volume" :: waited 0.063s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:06 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[185fc3dc-935a-4a19-94df-3117bc980746]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:06 devstack sudo[102473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac
Apr 29 10:29:06 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:06 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.473s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:29:06 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Deleted volume successfully.
Apr 29 10:29:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5ea63497-73f5-4e02-9447-4dff71b1f119 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-5b9fcc1e-0282-47e5-b607-eeeb9340ba34-delete_volume" released by "delete_volume" :: held 3.291s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:06 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.491s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:29:06 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Flow 'volume_create_manager' (0ce54e42-31c1-4c41-9b19-6ad3460b2ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626c8c4d-1312-4c3a-9716-398822a1c7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626c8c4d-1312-4c3a-9716-398822a1c7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-266940843',display_name='tempest-VolumesGetTest-Volume-1446563262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2657fbfa-8c70-4591-84ce-8209c7de9658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf7a660022146e3a2f17e6b6682815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:07Z,use_quota=True,user_id='da25d8364f934fa8872aa3701b6424c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005cabc8-72f2-47cf-bccc-f9fec3117a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005cabc8-72f2-47cf-bccc-f9fec3117a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec925a2-61ed-45b7-8e5a-4fba532a8428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec925a2-61ed-45b7-8e5a-4fba532a8428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2657fbfa-8c70-4591-84ce-8209c7de9658', 'volume_name': 'volume-2657fbfa-8c70-4591-84ce-8209c7de9658', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cf8b04-a1b4-4db7-9a6b-c989a42e4b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cf8b04-a1b4-4db7-9a6b-c989a42e4b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a64e6b9-4bcc-4a27-a7ac-b216f03b2153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:07 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Volume 2657fbfa-8c70-4591-84ce-8209c7de9658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2657fbfa-8c70-4591-84ce-8209c7de9658', 'volume_size': 1}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-266940843',display_name='tempest-VolumesGetTest-Volume-1446563262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2657fbfa-8c70-4591-84ce-8209c7de9658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf7a660022146e3a2f17e6b6682815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:07Z,use_quota=True,user_id='da25d8364f934fa8872aa3701b6424c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Creating volume 2657fbfa-8c70-4591-84ce-8209c7de9658 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:29:07 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2657fbfa-8c70-4591-84ce-8209c7de9658 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:07 devstack sudo[102482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2657fbfa-8c70-4591-84ce-8209c7de9658 1073741824
Apr 29 10:29:07 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:07 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac" returned: 0 in 1.442s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:07 devstack sudo[102487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac
Apr 29 10:29:07 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:08 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2657fbfa-8c70-4591-84ce-8209c7de9658 1073741824" returned: 0 in 1.319s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2657fbfa-8c70-4591-84ce-8209c7de9658 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:08 devstack sudo[102494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2657fbfa-8c70-4591-84ce-8209c7de9658
Apr 29 10:29:08 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:08 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-749a8e10-0e36-46d2-8a58-af5189e127ac" returned: 0 in 1.013s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:08 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-quobyte-749a8e10-0e36-46d2-8a58-af5189e127ac" released by "delete_volume" :: held 2.609s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:08 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Created reservations ['d2af25ef-b062-4cae-8a35-39f3855ce4da', 'a462d372-e682-4db7-a29a-c8693da1a17c', '727173dd-f259-4921-8ff4-19b47b9ac922', 'fba63af3-3d93-4e4f-8d0b-e83157d3ad05'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:29:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:09 devstack sudo[102496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:29:09 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:09 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2657fbfa-8c70-4591-84ce-8209c7de9658" returned: 0 in 1.194s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] <== create_volume: return (2591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:29:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.599s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a64e6b9-4bcc-4a27-a7ac-b216f03b2153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2657fbfa-8c70-4591-84ce-8209c7de9658', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95b44d5-02b7-4ae0-bca0-2c9de9463490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:09 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Volume volume-2657fbfa-8c70-4591-84ce-8209c7de9658 (2657fbfa-8c70-4591-84ce-8209c7de9658): created successfully
Apr 29 10:29:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95b44d5-02b7-4ae0-bca0-2c9de9463490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Flow 'volume_create_manager' (0ce54e42-31c1-4c41-9b19-6ad3460b2ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:09 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-b83a8134-3a70-455d-b3dd-e2df0b9aacee tempest-VolumesGetTest-350006876 None] Created volume successfully.
Apr 29 10:29:09 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.874s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:09 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:29:09 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Deleted volume successfully.
Apr 29 10:29:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2ad302bd-64d2-4696-8fda-cbea15c6fee2 tempest-VolumesSnapshotTestJSON-1648621122 None] Lock "cinder-749a8e10-0e36-46d2-8a58-af5189e127ac-delete_volume" released by "delete_volume" :: held 3.985s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-2657fbfa-8c70-4591-84ce-8209c7de9658-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Lock "cinder-2657fbfa-8c70-4591-84ce-8209c7de9658-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-quobyte-2657fbfa-8c70-4591-84ce-8209c7de9658" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-2657fbfa-8c70-4591-84ce-8209c7de9658" acquired by "delete_volume" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:10 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb6fd01-020f-4f73-b1aa-86220180f5e2]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2657fbfa-8c70-4591-84ce-8209c7de9658 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:10 devstack sudo[102500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2657fbfa-8c70-4591-84ce-8209c7de9658
Apr 29 10:29:10 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:11 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2657fbfa-8c70-4591-84ce-8209c7de9658" returned: 0 in 0.936s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2657fbfa-8c70-4591-84ce-8209c7de9658 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:11 devstack sudo[102507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2657fbfa-8c70-4591-84ce-8209c7de9658
Apr 29 10:29:11 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:12 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2657fbfa-8c70-4591-84ce-8209c7de9658" returned: 0 in 0.987s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:12 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-2657fbfa-8c70-4591-84ce-8209c7de9658" released by "delete_volume" :: held 1.990s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:12 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Created reservations ['d6969420-7fec-4288-90f7-e04738f76773', 'b31b6a95-342b-4be1-a5d9-d83d8aa39573', 'f9583a48-21a9-4957-bde3-76e387a2cac0', 'a38b79db-b7b7-4d15-8694-dae23f4a6350'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:29:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:12 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:12 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:12 devstack sudo[102512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:29:12 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:13 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.814s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:13 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:29:13 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Deleted volume successfully.
Apr 29 10:29:13 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-295769da-1967-457d-ac1c-a8d7e0af4d5f tempest-VolumesGetTest-350006876 None] Lock "cinder-2657fbfa-8c70-4591-84ce-8209c7de9658-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-7c1dfb63-9d47-4798-81a3-711dabe2dce5-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Lock "cinder-7c1dfb63-9d47-4798-81a3-711dabe2dce5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-quobyte-7c1dfb63-9d47-4798-81a3-711dabe2dce5" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-7c1dfb63-9d47-4798-81a3-711dabe2dce5" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:14 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23f9573-0ee3-407a-9eea-02917ec60103]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:14 devstack sudo[102516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5
Apr 29 10:29:14 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:15 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5" returned: 0 in 1.083s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:15 devstack sudo[102522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5
Apr 29 10:29:15 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:16 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c1dfb63-9d47-4798-81a3-711dabe2dce5" returned: 0 in 0.897s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:16 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-7c1dfb63-9d47-4798-81a3-711dabe2dce5" released by "delete_volume" :: held 2.034s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:16 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Created reservations ['f7617baa-a204-4417-ab8b-39853830ae8c', '2ddfd05d-d5a0-4c35-84a4-6ab6c252b154', '2720322e-7e70-4eaa-b6ad-4e5e86aea3da', '371eaeac-1fe5-433c-ac12-a7ec9b57aa6e'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:29:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:16 devstack sudo[102527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:29:16 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:17 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.684s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:17 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:29:17 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Deleted volume successfully.
Apr 29 10:29:17 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e814905e-2288-4fe8-9ff9-01e9bc1d3dce tempest-VolumesGetTest-350006876 None] Lock "cinder-7c1dfb63-9d47-4798-81a3-711dabe2dce5-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:17 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:29:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Flow 'volume_create_manager' (1274ae56-1b9e-4dd9-bbf9-50d0ceb76052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905e869d-45d5-4bac-afe8-6f506bac8c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905e869d-45d5-4bac-afe8-6f506bac8c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-713993934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5371c28d-c60a-4477-a3e6-a9b7d54b4d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf7a660022146e3a2f17e6b6682815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:18Z,use_quota=True,user_id='da25d8364f934fa8872aa3701b6424c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561da338-6346-4a18-bfcb-ffddd2e006bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561da338-6346-4a18-bfcb-ffddd2e006bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f50d69e-328b-4821-80f3-b669e7489f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f50d69e-328b-4821-80f3-b669e7489f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5371c28d-c60a-4477-a3e6-a9b7d54b4d06', 'volume_name': 'volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090cb58f-a249-44a2-a502-bca32cf88e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090cb58f-a249-44a2-a502-bca32cf88e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc27957-0822-439b-b33b-434579f40b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:18 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Volume 5371c28d-c60a-4477-a3e6-a9b7d54b4d06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06', 'volume_size': 1}
Apr 29 10:29:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-713993934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5371c28d-c60a-4477-a3e6-a9b7d54b4d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf7a660022146e3a2f17e6b6682815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:18Z,use_quota=True,user_id='da25d8364f934fa8872aa3701b6424c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:29:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Creating volume 5371c28d-c60a-4477-a3e6-a9b7d54b4d06 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:29:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:29:18 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:29:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:18 devstack sudo[102530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 1073741824
Apr 29 10:29:18 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:19 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 1073741824" returned: 0 in 1.006s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:19 devstack sudo[102536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06
Apr 29 10:29:19 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:19 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06" returned: 0 in 0.724s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:29:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc27957-0822-439b-b33b-434579f40b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839c08f1-508a-45b9-8742-1676d54220ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:19 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Volume volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 (5371c28d-c60a-4477-a3e6-a9b7d54b4d06): created successfully
Apr 29 10:29:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839c08f1-508a-45b9-8742-1676d54220ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Flow 'volume_create_manager' (1274ae56-1b9e-4dd9-bbf9-50d0ceb76052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:19 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-199f5fdb-c0bd-42f7-9faf-56eae263856d tempest-VolumesGetTest-350006876 None] Created volume successfully.
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Flow 'volume_create_manager' (5c192ddb-85b4-4c13-9850-1dc07931f93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a608d48-cb0e-4638-9bdf-05ed0f17cc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a608d48-cb0e-4638-9bdf-05ed0f17cc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-644373480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2cff6b2-0c29-4c4c-b911-b5c623804fcc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf7a660022146e3a2f17e6b6682815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=5371c28d-c60a-4477-a3e6-a9b7d54b4d06,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:21Z,use_quota=True,user_id='da25d8364f934fa8872aa3701b6424c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca79d973-3c1d-4847-a88c-cc567d259667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca79d973-3c1d-4847-a88c-cc567d259667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa32dfea-d5cc-445c-aa1e-b286a8b2fb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa32dfea-d5cc-445c-aa1e-b286a8b2fb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c2cff6b2-0c29-4c4c-b911-b5c623804fcc', 'volume_name': 'volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc', 'volume_size': 1, 'source_volid': '5371c28d-c60a-4477-a3e6-a9b7d54b4d06', 'source_volstatus': 'available'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cb4960-7ac7-4a9e-b028-77451f68e1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cb4960-7ac7-4a9e-b028-77451f68e1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6783ebc-6271-4b72-80e2-6245de2b0987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:20 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Volume c2cff6b2-0c29-4c4c-b911-b5c623804fcc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc', 'volume_size': 1, 'source_volid': '5371c28d-c60a-4477-a3e6-a9b7d54b4d06', 'source_volstatus': 'available'}
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:20 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Cloning volume 5371c28d-c60a-4477-a3e6-a9b7d54b4d06 to volume c2cff6b2-0c29-4c4c-b911-b5c623804fcc
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Creating offline snapshot c9b052dc-e6db-4dc8-aa8c-5c76c1b75148 of volume 5371c28d-c60a-4477-a3e6-a9b7d54b4d06 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad47ed8-e523-419a-9d41-19708cfeea73]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:20 devstack sudo[102607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06
Apr 29 10:29:20 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:21 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06" returned: 0 in 0.956s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:21 devstack sudo[102618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148 1G
Apr 29 10:29:21 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:22 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148 1G" returned: 0 in 0.885s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:22 devstack sudo[102629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148
Apr 29 10:29:22 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:23 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148" returned: 0 in 0.972s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:23 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148 is being set with open permissions: ugo+rw
Apr 29 10:29:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:23 devstack sudo[102657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148
Apr 29 10:29:23 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:24 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148" returned: 0 in 0.784s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:24 devstack sudo[102661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.info
Apr 29 10:29:24 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:25 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.info" returned: 0 in 0.684s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:25 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.info is being set with open permissions: ugo+rw
Apr 29 10:29:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:25 devstack sudo[102665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.info
Apr 29 10:29:25 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:25 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.info" returned: 0 in 0.703s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-quobyte-c2cff6b2-0c29-4c4c-b911-b5c623804fcc" by "_copy_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-c2cff6b2-0c29-4c4c-b911-b5c623804fcc" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] snapshot: c9b052dc-e6db-4dc8-aa8c-5c76c1b75148, volume: c2cff6b2-0c29-4c4c-b911-b5c623804fcc,  {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 10:29:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:25 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd8e6ef-9605-4130-8a86-5f187a8e7c22]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:26 devstack sudo[102668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148
Apr 29 10:29:26 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:27 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148" returned: 0 in 1.078s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:29:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 10:29:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Creating direct copy from snapshot {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 10:29:27 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[70da91bd-467d-4fa9-b3fe-19550218f2ae]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:27 devstack sudo[102675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06
Apr 29 10:29:27 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:28 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06" returned: 0 in 1.007s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:28 devstack cinder-volume[84165]: DEBUG cinder.utils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Path /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc not found in is_blk_device check {{(pid=84165) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 10:29:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:28 devstack sudo[102683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc
Apr 29 10:29:28 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:34 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:29:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Flow 'volume_create_manager' (e677ffce-9f02-4eb6-9c9f-44c8855dc0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92234e47-2743-44dc-9d88-a51f61250184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92234e47-2743-44dc-9d88-a51f61250184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-150631257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e655f7-4a54-4aff-a03c-1378d6f9320a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9189dafdaa84bdea7fdbf3a76ab0fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:34Z,use_quota=True,user_id='cf0b1a8ff1b54ea1843ad7f97b5b7b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5952d5-6033-4c81-9f2f-730c350f8467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5952d5-6033-4c81-9f2f-730c350f8467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd09b81-687a-4bf5-bb49-a8bc019fcd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd09b81-687a-4bf5-bb49-a8bc019fcd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e655f7-4a54-4aff-a03c-1378d6f9320a', 'volume_name': 'volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29af560b-115d-431a-b7d6-5990c0cc2f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29af560b-115d-431a-b7d6-5990c0cc2f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6ac869-226d-4514-952e-c4debc4f0ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:34 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Volume f4e655f7-4a54-4aff-a03c-1378d6f9320a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a', 'volume_size': 1}
Apr 29 10:29:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:34 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc" returned: 0 in 6.549s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:34 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[118b060b-966a-4d2d-88b5-17a287d33257]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:34 devstack sudo[102761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06
Apr 29 10:29:34 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:35 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06" returned: 0 in 1.259s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:35 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06, size 1024.00 MB, duration 6.55 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:29:35 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Converted 1024.00 MB image at 156.33 MB/s
Apr 29 10:29:35 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc is being set with open permissions: ugo+rw
Apr 29 10:29:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:35 devstack sudo[102769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc
Apr 29 10:29:35 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:36 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc" returned: 0 in 0.732s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:36 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-c2cff6b2-0c29-4c4c-b911-b5c623804fcc" released by "_copy_volume_from_snapshot" :: held 10.784s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:36 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-quobyte-c9b052dc-e6db-4dc8-aa8c-5c76c1b75148" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:36 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-c9b052dc-e6db-4dc8-aa8c-5c76c1b75148" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Deleting offline snapshot c9b052dc-e6db-4dc8-aa8c-5c76c1b75148 of volume 5371c28d-c60a-4477-a3e6-a9b7d54b4d06 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:29:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] snapshot_file for this snap is: volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:29:36 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca023360-be42-4f1f-9b16-5e9d2a969dc8]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:36 devstack sudo[102772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148
Apr 29 10:29:36 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:38 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148" returned: 0 in 1.231s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:38 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:29:38 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfd7a8e-0452-43d6-acf5-367da68e8ca9]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:38 devstack sudo[102777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06
Apr 29 10:29:38 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:39 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06" returned: 0 in 1.111s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:39 devstack sudo[102782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148
Apr 29 10:29:39 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:40 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148" returned: 0 in 1.021s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:40 devstack sudo[102789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148
Apr 29 10:29:40 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:41 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06.c9b052dc-e6db-4dc8-aa8c-5c76c1b75148" returned: 0 in 0.941s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-c9b052dc-e6db-4dc8-aa8c-5c76c1b75148" released by "_delete_snapshot" :: held 4.471s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.553s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.947s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-150631257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e655f7-4a54-4aff-a03c-1378d6f9320a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9189dafdaa84bdea7fdbf3a76ab0fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:34Z,use_quota=True,user_id='cf0b1a8ff1b54ea1843ad7f97b5b7b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Creating volume f4e655f7-4a54-4aff-a03c-1378d6f9320a {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:29:41 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:41 devstack sudo[102793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a 1073741824
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6783ebc-6271-4b72-80e2-6245de2b0987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc', 'volume_size': 1, 'source_volid': '5371c28d-c60a-4477-a3e6-a9b7d54b4d06', 'source_volstatus': 'available'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:41 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c739217-6644-4398-b400-541ae1fa8e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:41 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Volume volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc (c2cff6b2-0c29-4c4c-b911-b5c623804fcc): created successfully
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c739217-6644-4398-b400-541ae1fa8e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Flow 'volume_create_manager' (5c192ddb-85b4-4c13-9850-1dc07931f93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:41 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c2e7a9b8-747c-4ba0-8787-b429e12ce45f tempest-VolumesGetTest-350006876 None] Created volume successfully.
Apr 29 10:29:43 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a 1073741824" returned: 0 in 1.733s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:43 devstack sudo[102799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a
Apr 29 10:29:43 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:43 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:29:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Flow 'volume_create_manager' (e4fafa38-0adf-4128-a631-eb3719d96ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79431ca6-f71b-4305-915e-9b9ea5d88bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79431ca6-f71b-4305-915e-9b9ea5d88bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1580203321',display_name='tempest-VolumesGetTest-Volume-2086895930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79212aa9-a279-4875-8198-ad31e08dfe22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf7a660022146e3a2f17e6b6682815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:43Z,use_quota=True,user_id='da25d8364f934fa8872aa3701b6424c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c79a776-08bd-4fb0-b6a5-c016de40679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c79a776-08bd-4fb0-b6a5-c016de40679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1c5792-06d5-49c5-be4a-be32fcac2f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1c5792-06d5-49c5-be4a-be32fcac2f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79212aa9-a279-4875-8198-ad31e08dfe22', 'volume_name': 'volume-79212aa9-a279-4875-8198-ad31e08dfe22', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d02d8fa-2461-432f-80db-a215021f7ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d02d8fa-2461-432f-80db-a215021f7ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7fe336-a831-488f-aff8-981cfc9722ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:43 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Volume 79212aa9-a279-4875-8198-ad31e08dfe22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79212aa9-a279-4875-8198-ad31e08dfe22', 'volume_size': 1}
Apr 29 10:29:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:44 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a" returned: 0 in 0.982s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] <== create_volume: return (2792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.799s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.360s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1580203321',display_name='tempest-VolumesGetTest-Volume-2086895930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79212aa9-a279-4875-8198-ad31e08dfe22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf7a660022146e3a2f17e6b6682815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:43Z,use_quota=True,user_id='da25d8364f934fa8872aa3701b6424c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Creating volume 79212aa9-a279-4875-8198-ad31e08dfe22 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:29:44 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-79212aa9-a279-4875-8198-ad31e08dfe22 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:44 devstack sudo[102803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-79212aa9-a279-4875-8198-ad31e08dfe22 1073741824
Apr 29 10:29:44 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6ac869-226d-4514-952e-c4debc4f0ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a344e9-b698-4de9-ab75-6bcff1f23d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:44 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Volume volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a (f4e655f7-4a54-4aff-a03c-1378d6f9320a): created successfully
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a344e9-b698-4de9-ab75-6bcff1f23d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Flow 'volume_create_manager' (e677ffce-9f02-4eb6-9c9f-44c8855dc0cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:44 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-41112306-5a19-465b-a3ae-6d18f87c86ec tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Created volume successfully.
Apr 29 10:29:45 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-79212aa9-a279-4875-8198-ad31e08dfe22 1073741824" returned: 0 in 1.171s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-79212aa9-a279-4875-8198-ad31e08dfe22 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:45 devstack sudo[102809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-79212aa9-a279-4875-8198-ad31e08dfe22
Apr 29 10:29:45 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:45 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-79212aa9-a279-4875-8198-ad31e08dfe22" returned: 0 in 0.712s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:29:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7fe336-a831-488f-aff8-981cfc9722ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79212aa9-a279-4875-8198-ad31e08dfe22', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e15681-0272-41c8-aa3a-14e80eb44e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:46 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Volume volume-79212aa9-a279-4875-8198-ad31e08dfe22 (79212aa9-a279-4875-8198-ad31e08dfe22): created successfully
Apr 29 10:29:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e15681-0272-41c8-aa3a-14e80eb44e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Flow 'volume_create_manager' (e4fafa38-0adf-4128-a631-eb3719d96ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:46 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3ebfe652-1e07-4874-a5eb-2af81eeb3bdb tempest-VolumesGetTest-350006876 None] Created volume successfully.
Apr 29 10:29:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-79212aa9-a279-4875-8198-ad31e08dfe22-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Lock "cinder-79212aa9-a279-4875-8198-ad31e08dfe22-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-quobyte-79212aa9-a279-4875-8198-ad31e08dfe22" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-79212aa9-a279-4875-8198-ad31e08dfe22" acquired by "delete_volume" :: waited 0.037s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe3e9d5-b573-4400-b3b5-4ffe164210c7]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-79212aa9-a279-4875-8198-ad31e08dfe22 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:47 devstack sudo[102812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-79212aa9-a279-4875-8198-ad31e08dfe22
Apr 29 10:29:47 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Flow 'volume_create_manager' (f5c29055-d2e5-462d-98f5-72ef20320a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8756759-49e1-4489-b4ef-ea8be6458875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8756759-49e1-4489-b4ef-ea8be6458875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1655023907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f690aaf-4f07-4891-8346-558afc825dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a168ba5e23ff474e8e8ae6ea3b138205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:48Z,use_quota=True,user_id='fe39c8d151bd458ebb4194b51de77d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f4926ef-4c82-47ba-9758-a6d574753770),volume_type_id=9f4926ef-4c82-47ba-9758-a6d574753770)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b60d235-77b7-445a-9490-c54b48f91e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b60d235-77b7-445a-9490-c54b48f91e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0111cb59-0e4e-4bca-a9f8-81d3b500edcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0111cb59-0e4e-4bca-a9f8-81d3b500edcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f690aaf-4f07-4891-8346-558afc825dbd', 'volume_name': 'volume-8f690aaf-4f07-4891-8346-558afc825dbd', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79268af8-fb8a-4fef-beea-1e4b52c65427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79268af8-fb8a-4fef-beea-1e4b52c65427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58778988-5524-44cd-8f9e-c5947e6f6805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:47 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Volume 8f690aaf-4f07-4891-8346-558afc825dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f690aaf-4f07-4891-8346-558afc825dbd', 'volume_size': 1}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1655023907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f690aaf-4f07-4891-8346-558afc825dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a168ba5e23ff474e8e8ae6ea3b138205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:48Z,use_quota=True,user_id='fe39c8d151bd458ebb4194b51de77d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f4926ef-4c82-47ba-9758-a6d574753770),volume_type_id=9f4926ef-4c82-47ba-9758-a6d574753770)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Creating volume 8f690aaf-4f07-4891-8346-558afc825dbd {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:29:47 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:29:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8f690aaf-4f07-4891-8346-558afc825dbd 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:48 devstack sudo[102834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8f690aaf-4f07-4891-8346-558afc825dbd 1073741824
Apr 29 10:29:48 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:48 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-79212aa9-a279-4875-8198-ad31e08dfe22" returned: 0 in 1.017s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-79212aa9-a279-4875-8198-ad31e08dfe22 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:48 devstack sudo[102836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-79212aa9-a279-4875-8198-ad31e08dfe22
Apr 29 10:29:48 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Flow 'volume_create_manager' (caab89dc-a483-41b9-b248-b3c6c16b95c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48224b95-0a50-4ac1-9876-2461474626b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48224b95-0a50-4ac1-9876-2461474626b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2087374251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a168ba5e23ff474e8e8ae6ea3b138205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:48Z,use_quota=True,user_id='fe39c8d151bd458ebb4194b51de77d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(138e5779-3f4b-45ef-aee6-603f9b128367),volume_type_id=138e5779-3f4b-45ef-aee6-603f9b128367)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac220df-7946-47dc-a23c-3e57598f7614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac220df-7946-47dc-a23c-3e57598f7614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f5130b-e657-401c-9155-d451c3e4b2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f5130b-e657-401c-9155-d451c3e4b2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5', 'volume_name': 'volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b55b6a9-dbe9-4f67-9e6c-5e789f140ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b55b6a9-dbe9-4f67-9e6c-5e789f140ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfb1825-bcbe-44d8-963f-46b65bd3813b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:48 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Volume cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5', 'volume_size': 1}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-090118df-d3f8-4660-8b32-2a151cd57546 req-cc444acc-24a7-4261-abf5-54270b4ee795 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:48 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-79212aa9-a279-4875-8198-ad31e08dfe22" returned: 0 in 0.695s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-79212aa9-a279-4875-8198-ad31e08dfe22" released by "delete_volume" :: held 1.777s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Created reservations ['ad766f8e-671e-4dd1-873f-37d9ccedacb3', '983380ac-5eec-41e2-ae61-a5ae0ce7abad', 'b96c6d0e-03fd-450c-b8dc-18baad624705', '882f85d3-e989-47ae-b401-0a5f90d40e8c'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Flow 'volume_create_manager' (6e0f9aba-5cbc-4c87-8113-38d5c2f2eb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a8ae04-9466-49a9-a85a-bc2bc66c3a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a8ae04-9466-49a9-a85a-bc2bc66c3a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1104862549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3997ca0-aad2-4f58-be82-cc15509bb247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a168ba5e23ff474e8e8ae6ea3b138205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:49Z,use_quota=True,user_id='fe39c8d151bd458ebb4194b51de77d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36e0fa44-0449-4f3c-ace7-a2e945b8aa95),volume_type_id=36e0fa44-0449-4f3c-ace7-a2e945b8aa95)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a417d31f-c1c5-496c-9f40-f1d67f96c560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a417d31f-c1c5-496c-9f40-f1d67f96c560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f38c8ba-1b40-43c7-a3ac-77c15e79b851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:48 devstack cinder-volume[84165]: DEBUG cinder.image.glance [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Creating Keystone auth plugin from conf {{(pid=84165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:49 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8f690aaf-4f07-4891-8346-558afc825dbd 1073741824" returned: 0 in 1.086s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:49 devstack sudo[102851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:29:49 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8f690aaf-4f07-4891-8346-558afc825dbd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:49 devstack sudo[102853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8f690aaf-4f07-4891-8346-558afc825dbd
Apr 29 10:29:49 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f38c8ba-1b40-43c7-a3ac-77c15e79b851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3997ca0-aad2-4f58-be82-cc15509bb247', 'volume_name': 'volume-d3997ca0-aad2-4f58-be82-cc15509bb247', 'volume_size': 1, 'image_id': 'ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1704446625', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a168ba5e23ff474e8e8ae6ea3b138205', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c', 'created_at': datetime.datetime(2026, 4, 29, 8, 29, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 29, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52464a0d10>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98fab86b-6062-4d0a-9a36-76f733194b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98fab86b-6062-4d0a-9a36-76f733194b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69c312c-c9bb-4334-9bbe-ce3b8e214d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:49 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Volume d3997ca0-aad2-4f58-be82-cc15509bb247: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3997ca0-aad2-4f58-be82-cc15509bb247', 'volume_size': 1, 'image_id': 'ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1704446625', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a168ba5e23ff474e8e8ae6ea3b138205', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c', 'created_at': datetime.datetime(2026, 4, 29, 8, 29, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 29, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52464a0d10>}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Trying to clone d3997ca0-aad2-4f58-be82-cc15509bb247 from image ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c at location (None, [{'url': 'file:///opt/stack/data/glance/images/ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c', 'metadata': {}}]). {{(pid=84165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-c2cff6b2-0c29-4c4c-b911-b5c623804fcc-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Lock "cinder-c2cff6b2-0c29-4c4c-b911-b5c623804fcc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-quobyte-c2cff6b2-0c29-4c4c-b911-b5c623804fcc" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-c2cff6b2-0c29-4c4c-b911-b5c623804fcc" acquired by "delete_volume" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7473c2ec-7dca-4e0d-a397-f6fb8342f8f6]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:49 devstack sudo[102855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc
Apr 29 10:29:49 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:49 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.731s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:29:49 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Deleted volume successfully.
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c28b0eb0-7c0e-48ea-97aa-7cd3c5f5e6d8 tempest-VolumesGetTest-350006876 None] Lock "cinder-79212aa9-a279-4875-8198-ad31e08dfe22-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:49 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8f690aaf-4f07-4891-8346-558afc825dbd" returned: 0 in 0.841s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.557s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2087374251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a168ba5e23ff474e8e8ae6ea3b138205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:48Z,use_quota=True,user_id='fe39c8d151bd458ebb4194b51de77d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(138e5779-3f4b-45ef-aee6-603f9b128367),volume_type_id=138e5779-3f4b-45ef-aee6-603f9b128367)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Creating volume cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:29:49 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:49 devstack sudo[102859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5 1073741824
Apr 29 10:29:49 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58778988-5524-44cd-8f9e-c5947e6f6805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f690aaf-4f07-4891-8346-558afc825dbd', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9996bcd6-067a-4fce-852d-1d47b0069e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:50 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Volume volume-8f690aaf-4f07-4891-8346-558afc825dbd (8f690aaf-4f07-4891-8346-558afc825dbd): created successfully
Apr 29 10:29:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9996bcd6-067a-4fce-852d-1d47b0069e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Flow 'volume_create_manager' (f5c29055-d2e5-462d-98f5-72ef20320a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:50 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e747d5f0-cd05-430e-86e3-e10836dc5fa5 tempest-TestInstancesWithCinderVolumes-1374990074 None] Created volume successfully.
Apr 29 10:29:50 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc" returned: 0 in 0.803s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:50 devstack sudo[102865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc
Apr 29 10:29:50 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:50 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5 1073741824" returned: 0 in 0.973s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:50 devstack sudo[102872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5
Apr 29 10:29:50 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:51 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c2cff6b2-0c29-4c4c-b911-b5c623804fcc" returned: 0 in 0.694s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-c2cff6b2-0c29-4c4c-b911-b5c623804fcc" released by "delete_volume" :: held 1.568s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Created reservations ['6d9b5d99-01cc-4f0c-a111-cc352dfcc3b4', 'b3bfbc1b-6484-4725-860a-7bec25fd1748', 'e1c3085c-b061-4159-a6c9-b4857bf9a791', '579e95f8-aabe-402d-82c0-6dc6612ae7ab'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:51 devstack sudo[102874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:29:51 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:51 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5" returned: 0 in 0.646s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-090118df-d3f8-4660-8b32-2a151cd57546 req-cc444acc-24a7-4261-abf5-54270b4ee795 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.818s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfb1825-bcbe-44d8-963f-46b65bd3813b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03664c0-96a0-466f-b3ac-5292d6d0ec61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6143d6c0-2ed5-4953-ac5f-e28d4dac9ee1]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-090118df-d3f8-4660-8b32-2a151cd57546 req-cc444acc-24a7-4261-abf5-54270b4ee795 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:51 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Volume volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5 (cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5): created successfully
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03664c0-96a0-466f-b3ac-5292d6d0ec61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Flow 'volume_create_manager' (caab89dc-a483-41b9-b248-b3c6c16b95c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:51 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-58c149e1-34c9-4e58-bd63-875847328a83 tempest-TestInstancesWithCinderVolumes-1374990074 None] Created volume successfully.
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-5371c28d-c60a-4477-a3e6-a9b7d54b4d06-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:51 devstack sudo[102877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Lock "cinder-5371c28d-c60a-4477-a3e6-a9b7d54b4d06-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:51 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:51 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.714s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-quobyte-5371c28d-c60a-4477-a3e6-a9b7d54b4d06" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:29:51 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Deleted volume successfully.
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-5371c28d-c60a-4477-a3e6-a9b7d54b4d06" acquired by "delete_volume" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ef7f0bde-2287-44d4-819a-7239e1eb2d01 tempest-VolumesGetTest-350006876 None] Lock "cinder-c2cff6b2-0c29-4c4c-b911-b5c623804fcc-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[693dbdf1-222d-4ca5-aa94-ad3ee037dd6e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:52 devstack sudo[102880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06
Apr 29 10:29:52 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:52 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-090118df-d3f8-4660-8b32-2a151cd57546 req-cc444acc-24a7-4261-abf5-54270b4ee795 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a" returned: 0 in 0.844s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-090118df-d3f8-4660-8b32-2a151cd57546 req-cc444acc-24a7-4261-abf5-54270b4ee795 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.879s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-090118df-d3f8-4660-8b32-2a151cd57546 req-cc444acc-24a7-4261-abf5-54270b4ee795 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f563060-382b-4df3-978e-586b68439ee0', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:29:52 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-090118df-d3f8-4660-8b32-2a151cd57546 req-cc444acc-24a7-4261-abf5-54270b4ee795 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] attachment_update completed successfully.
Apr 29 10:29:52 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06" returned: 0 in 0.756s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:52 devstack sudo[102889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06
Apr 29 10:29:52 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:53 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c__bslt5ytdevstack@QuobyteHD, size 20.69 MB, duration 3.88 sec {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 10:29:53 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Image download 20.69 MB at 5.33 MB/s
Apr 29 10:29:53 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c201d9c-5f76-467e-9abe-0eeab08b9326]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c__bslt5ytdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:53 devstack sudo[102958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c__bslt5ytdevstack@QuobyteHD
Apr 29 10:29:53 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:53 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5371c28d-c60a-4477-a3e6-a9b7d54b4d06" returned: 0 in 0.707s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-5371c28d-c60a-4477-a3e6-a9b7d54b4d06" released by "delete_volume" :: held 1.533s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:53 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Created reservations ['f55f55b6-197f-4c1b-95a3-4588bf2e5762', '5a699dd9-86e3-4550-b8a9-5a8da620dacd', '4fb0164d-72c7-4fad-8549-fc7641635fbc', 'f0b33d29-b981-4361-9744-acebd8fad216'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:29:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:53 devstack sudo[102962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:29:53 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:53 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c__bslt5ytdevstack@QuobyteHD" returned: 0 in 0.735s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:53 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Temporary image ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c is fetched for user fe39c8d151bd458ebb4194b51de77d7f. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[caee1781-84ba-4a80-a869-21db48c3a82f]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c__bslt5ytdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:54 devstack sudo[103282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c__bslt5ytdevstack@QuobyteHD
Apr 29 10:29:54 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:54 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.632s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:29:54 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Deleted volume successfully.
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a6ba97b4-647b-46d8-96e9-c1535cd4587f tempest-VolumesGetTest-350006876 None] Lock "cinder-5371c28d-c60a-4477-a3e6-a9b7d54b4d06-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Flow 'volume_create_manager' (99ab426b-381b-4095-b9b1-b80600ca89c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:29:54 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89232797-c056-46a9-83b4-bf477fbfba43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c__bslt5ytdevstack@QuobyteHD" returned: 0 in 0.812s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1104862549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3997ca0-aad2-4f58-be82-cc15509bb247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a168ba5e23ff474e8e8ae6ea3b138205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:49Z,use_quota=True,user_id='fe39c8d151bd458ebb4194b51de77d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36e0fa44-0449-4f3c-ace7-a2e945b8aa95),volume_type_id=36e0fa44-0449-4f3c-ace7-a2e945b8aa95)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Creating volume d3997ca0-aad2-4f58-be82-cc15509bb247 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:29:54 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89232797-c056-46a9-83b4-bf477fbfba43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-353134921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37269c41-2995-4774-8dd7-2b3af8203cfd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf7a660022146e3a2f17e6b6682815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:55Z,use_quota=True,user_id='da25d8364f934fa8872aa3701b6424c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26127c4-3fba-4db9-a0bd-ea2009854620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26127c4-3fba-4db9-a0bd-ea2009854620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:54 devstack sudo[103288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 1073741824
Apr 29 10:29:54 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7877f088-865a-4d13-94f6-93f2398f0bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:54 devstack cinder-volume[84165]: DEBUG cinder.image.glance [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Creating Keystone auth plugin from conf {{(pid=84165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 10:29:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7877f088-865a-4d13-94f6-93f2398f0bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '37269c41-2995-4774-8dd7-2b3af8203cfd', 'volume_name': 'volume-37269c41-2995-4774-8dd7-2b3af8203cfd', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52464f4920>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85046ff9-6787-46c0-bbdb-a23b1f4f5485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85046ff9-6787-46c0-bbdb-a23b1f4f5485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:29:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25768cf5-dbb6-4cfb-8c45-a1a38fa34612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:29:55 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Volume 37269c41-2995-4774-8dd7-2b3af8203cfd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-37269c41-2995-4774-8dd7-2b3af8203cfd', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52464f4920>}
Apr 29 10:29:55 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Trying to clone 37269c41-2995-4774-8dd7-2b3af8203cfd from image 718e863a-88e0-4753-95be-273177fb3fd1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]). {{(pid=84165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 29 10:29:55 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_ppv83d0idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 10:29:55 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 10:29:55 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef30bc73-d321-4253-9d1e-ae76b74ace39]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_ppv83d0idevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:55 devstack sudo[103294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_ppv83d0idevstack@QuobyteHD
Apr 29 10:29:55 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:55 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 1073741824" returned: 0 in 1.045s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:55 devstack sudo[103296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247
Apr 29 10:29:55 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:56 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_ppv83d0idevstack@QuobyteHD" returned: 0 in 0.739s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:56 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 is fetched for user da25d8364f934fa8872aa3701b6424c9. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 10:29:56 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acdf45a-74e8-4c31-91dc-cca1478edce5]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_ppv83d0idevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:56 devstack sudo[103301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_ppv83d0idevstack@QuobyteHD
Apr 29 10:29:56 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:56 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247" returned: 0 in 0.645s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:29:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:56 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Attempting download of ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c ((None, [{'url': 'file:///opt/stack/data/glance/images/ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c', 'metadata': {}}])) to volume d3997ca0-aad2-4f58-be82-cc15509bb247. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 10:29:56 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[64580ee6-fb09-4748-9762-9f6aed4f9859]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c_sp5sjvq9 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:56 devstack sudo[103304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c_sp5sjvq9
Apr 29 10:29:56 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:57 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_ppv83d0idevstack@QuobyteHD" returned: 0 in 0.829s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-353134921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37269c41-2995-4774-8dd7-2b3af8203cfd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf7a660022146e3a2f17e6b6682815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:55Z,use_quota=True,user_id='da25d8364f934fa8872aa3701b6424c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:29:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Creating volume 37269c41-2995-4774-8dd7-2b3af8203cfd {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:29:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:29:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:29:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:29:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:29:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:29:57 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:29:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:57 devstack sudo[103309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd 1073741824
Apr 29 10:29:57 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:57 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c_sp5sjvq9" returned: 0 in 0.804s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c_sp5sjvq9 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:57 devstack sudo[103313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c_sp5sjvq9
Apr 29 10:29:57 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:58 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd 1073741824" returned: 0 in 0.916s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:58 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c_sp5sjvq9" returned: 1 in 0.737s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c_sp5sjvq9' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:29:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c829e7-6b5e-4056-8602-11ee40a69658]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c__bslt5ytdevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:58 devstack sudo[103322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd
Apr 29 10:29:58 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:58 devstack sudo[103321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c__bslt5ytdevstack@QuobyteHD
Apr 29 10:29:58 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:58 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd" returned: 0 in 0.597s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:29:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:29:58 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Attempting download of 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume 37269c41-2995-4774-8dd7-2b3af8203cfd. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 10:29:58 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c__bslt5ytdevstack@QuobyteHD" returned: 0 in 0.696s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:58 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c was qcow2, converting to raw {{(pid=84165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 10:29:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c__bslt5ytdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:58 devstack sudo[103329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c__bslt5ytdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247
Apr 29 10:29:58 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab331d72-7a8e-4432-9c10-638b1edc646c]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:29:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_9hgg_nih {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:59 devstack sudo[103331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_9hgg_nih
Apr 29 10:29:59 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:29:59 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-15f2eef2-6f7d-44e2-bd31-6ac26c185afa req-8b264944-9201-4ec3-96e3-e134b7eb9358 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Terminate volume connection completed successfully.
Apr 29 10:29:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-15f2eef2-6f7d-44e2-bd31-6ac26c185afa req-8b264944-9201-4ec3-96e3-e134b7eb9358 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Deleting attachment 7f563060-382b-4df3-978e-586b68439ee0. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:29:59 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root
Apr 29 10:29:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_9hgg_nih" returned: 0 in 0.720s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:29:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_9hgg_nih {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:29:59 devstack sudo[103378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_9hgg_nih
Apr 29 10:29:59 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:00 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_9hgg_nih" returned: 1 in 0.803s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_9hgg_nih' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3d26e1-e192-402c-afa6-e286ceb0ad6d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_ppv83d0idevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Flow 'volume_create_manager' (e3e1b76b-fa6b-4c7c-97c0-28bbb730359e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a7bdd8-de59-4a37-ba65-c21e2ca49383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:00 devstack sudo[103386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_ppv83d0idevstack@QuobyteHD
Apr 29 10:30:00 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a7bdd8-de59-4a37-ba65-c21e2ca49383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-190531832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8addca-8d6d-4f7d-8ecb-be4a72639b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00d318c9a004d64bce2b22ee45b192e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:30:01Z,use_quota=True,user_id='3afc570f73c94205893b9a803e3e0cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526fe322-4a5b-43e8-8d91-8aa2c1438b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526fe322-4a5b-43e8-8d91-8aa2c1438b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9318e5-e69a-4ace-a06b-47846fe9ade4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9318e5-e69a-4ace-a06b-47846fe9ade4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb8addca-8d6d-4f7d-8ecb-be4a72639b25', 'volume_name': 'volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fdaf57-0356-4fca-b48c-355391921a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fdaf57-0356-4fca-b48c-355391921a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb013e8-9571-4fa3-b0ee-7894b99432f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:00 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Volume fb8addca-8d6d-4f7d-8ecb-be4a72639b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25', 'volume_size': 1}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-190531832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8addca-8d6d-4f7d-8ecb-be4a72639b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00d318c9a004d64bce2b22ee45b192e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:30:01Z,use_quota=True,user_id='3afc570f73c94205893b9a803e3e0cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Creating volume fb8addca-8d6d-4f7d-8ecb-be4a72639b25 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:30:00 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:30:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:00 devstack sudo[103388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25 1073741824
Apr 29 10:30:00 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:01 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c__bslt5ytdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247" returned: 0 in 2.200s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:01 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c__bslt5ytdevstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:30:01 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Converted 112.00 MB image at 50.88 MB/s
Apr 29 10:30:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:01 devstack sudo[103393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 1G
Apr 29 10:30:01 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:01 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_ppv83d0idevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:01 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] 718e863a-88e0-4753-95be-273177fb3fd1 was qcow2, converting to raw {{(pid=84165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 10:30:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_ppv83d0idevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:01 devstack sudo[103395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_ppv83d0idevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd
Apr 29 10:30:01 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:01 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25 1073741824" returned: 0 in 0.945s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:01 devstack sudo[103401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25
Apr 29 10:30:01 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Acquiring lock "cinder-f4e655f7-4a54-4aff-a03c-1378d6f9320a-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Lock "cinder-f4e655f7-4a54-4aff-a03c-1378d6f9320a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Acquiring lock "cinder-quobyte-f4e655f7-4a54-4aff-a03c-1378d6f9320a" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Lock "cinder-quobyte-f4e655f7-4a54-4aff-a03c-1378d6f9320a" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:01 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 1G" returned: 0 in 0.821s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:01 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dbbc22-6214-47ab-a25a-ce70c91cfb33]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:02 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79a6faa-eb38-4269-85e1-a4ed8a73ee0f]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:02 devstack sudo[103411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a
Apr 29 10:30:02 devstack sudo[103413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247
Apr 29 10:30:02 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:02 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:02 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25" returned: 0 in 0.777s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:30:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb013e8-9571-4fa3-b0ee-7894b99432f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e317c5c-e45f-473e-a086-5ea2e17b40e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:02 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Volume volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25 (fb8addca-8d6d-4f7d-8ecb-be4a72639b25): created successfully
Apr 29 10:30:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e317c5c-e45f-473e-a086-5ea2e17b40e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Flow 'volume_create_manager' (e3e1b76b-fa6b-4c7c-97c0-28bbb730359e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:30:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-067c94ff-dcad-4815-956c-0ff87e1a4fd5 tempest-AttachVolumeTestJSON-1917629784 None] Created volume successfully.
Apr 29 10:30:02 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247" returned: 0 in 0.829s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:02 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a" returned: 0 in 0.973s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:02 devstack sudo[103423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247
Apr 29 10:30:02 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:03 devstack sudo[103424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a
Apr 29 10:30:03 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:03 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_ppv83d0idevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd" returned: 0 in 2.213s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_ppv83d0idevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:30:03 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Converted 112.00 MB image at 50.57 MB/s
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:03 devstack sudo[103428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd 1G
Apr 29 10:30:03 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:03 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247" returned: 1 in 0.827s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Downloaded image ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c ((None, [{'url': 'file:///opt/stack/data/glance/images/ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c', 'metadata': {}}])) to volume d3997ca0-aad2-4f58-be82-cc15509bb247 successfully. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 10:30:03 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Temporary image ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c for user fe39c8d151bd458ebb4194b51de77d7f is deleted. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Marking volume d3997ca0-aad2-4f58-be82-cc15509bb247 as bootable. {{(pid=84165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f4e655f7-4a54-4aff-a03c-1378d6f9320a" returned: 0 in 0.731s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Lock "cinder-quobyte-f4e655f7-4a54-4aff-a03c-1378d6f9320a" released by "delete_volume" :: held 1.764s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Copying metadata from image ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c to d3997ca0-aad2-4f58-be82-cc15509bb247. {{(pid=84165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Creating volume glance metadata for volume d3997ca0-aad2-4f58-be82-cc15509bb247 backed by image ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c with: {'image_id': 'ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c', 'image_name': 'tempest-scenario-img--1704446625', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Created reservations ['1ca46a1a-3f0d-49e9-833e-f1322226d470', 'a4606dca-080e-4eea-9f54-f4e6be1b6aab', '4312e20e-e307-4f99-a46c-603051f5f5c5', '6e282018-81aa-4a8f-affb-cfd1a1d49651'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69c312c-c9bb-4334-9bbe-ce3b8e214d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3997ca0-aad2-4f58-be82-cc15509bb247', 'volume_size': 1, 'image_id': 'ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1704446625', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a168ba5e23ff474e8e8ae6ea3b138205', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c', 'created_at': datetime.datetime(2026, 4, 29, 8, 29, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 29, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ceceafa6-fdd8-47dc-abe3-4e0a0a3cae3c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52464a0d10>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedcf478-b05b-4bd3-8dea-b75323803150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:03 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Volume volume-d3997ca0-aad2-4f58-be82-cc15509bb247 (d3997ca0-aad2-4f58-be82-cc15509bb247): created successfully
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedcf478-b05b-4bd3-8dea-b75323803150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Flow 'volume_create_manager' (6e0f9aba-5cbc-4c87-8113-38d5c2f2eb97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:03 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-6be7d813-5e15-4a0a-bc90-347d712a0ed4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Created volume successfully.
Apr 29 10:30:03 devstack sudo[103434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:30:03 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:04 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd 1G" returned: 0 in 0.781s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:04 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a4615b-cb18-4074-970b-fd03b289c3d1]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:04 devstack sudo[103439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd
Apr 29 10:30:04 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:04 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.656s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:04 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:30:04 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Deleted volume successfully.
Apr 29 10:30:04 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:INSERT=29,cinder:UPDATE=98,cinder:SELECT=76,cinder:DELETE=10 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:30:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d3010fb9-6f40-4aa3-9c0d-40c1ce9a2f27 tempest-TestServerVolumeAttachScenarioOldVersion-1377376848 None] Lock "cinder-f4e655f7-4a54-4aff-a03c-1378d6f9320a-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:05 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd" returned: 0 in 0.757s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:05 devstack sudo[103444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd
Apr 29 10:30:05 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:30:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:30:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:30:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:05 devstack sudo[103478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:30:05 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:06 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd" returned: 1 in 1.156s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Downloaded image 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume 37269c41-2995-4774-8dd7-2b3af8203cfd successfully. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 for user da25d8364f934fa8872aa3701b6424c9 is deleted. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Marking volume 37269c41-2995-4774-8dd7-2b3af8203cfd as bootable. {{(pid=84165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=75,cinder:INSERT=26,cinder:UPDATE=103,cinder:DELETE=8 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Copying metadata from image 718e863a-88e0-4753-95be-273177fb3fd1 to 37269c41-2995-4774-8dd7-2b3af8203cfd. {{(pid=84165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Creating volume glance metadata for volume 37269c41-2995-4774-8dd7-2b3af8203cfd backed by image 718e863a-88e0-4753-95be-273177fb3fd1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-2c220b87-5402-4f60-82ef-6aa2f60edfc7 req-fff3361a-3a32-49e4-89e1-c1931fb32a26 tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-2c220b87-5402-4f60-82ef-6aa2f60edfc7 req-fff3361a-3a32-49e4-89e1-c1931fb32a26 tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25768cf5-dbb6-4cfb-8c45-a1a38fa34612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37269c41-2995-4774-8dd7-2b3af8203cfd', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f52464f4920>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398ecb81-0d74-4eb8-8667-52a5ed768846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[53662720-2e76-4b75-958e-a770c95fb2d6]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-2c220b87-5402-4f60-82ef-6aa2f60edfc7 req-fff3361a-3a32-49e4-89e1-c1931fb32a26 tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:06 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.936s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:30:06 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Volume volume-37269c41-2995-4774-8dd7-2b3af8203cfd (37269c41-2995-4774-8dd7-2b3af8203cfd): created successfully
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398ecb81-0d74-4eb8-8667-52a5ed768846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Flow 'volume_create_manager' (99ab426b-381b-4095-b9b1-b80600ca89c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:30:06 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-cdbb01b9-27e9-4874-932a-aa057aa008d5 tempest-VolumesGetTest-350006876 None] Created volume successfully.
Apr 29 10:30:06 devstack sudo[103497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25
Apr 29 10:30:06 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:07 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-2c220b87-5402-4f60-82ef-6aa2f60edfc7 req-fff3361a-3a32-49e4-89e1-c1931fb32a26 tempest-AttachVolumeTestJSON-1917629784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25" returned: 0 in 0.908s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-2c220b87-5402-4f60-82ef-6aa2f60edfc7 req-fff3361a-3a32-49e4-89e1-c1931fb32a26 tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.942s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-2c220b87-5402-4f60-82ef-6aa2f60edfc7 req-fff3361a-3a32-49e4-89e1-c1931fb32a26 tempest-AttachVolumeTestJSON-1917629784 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a88e49cd-add5-4512-aefe-1d2a22236080', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:30:07 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-2c220b87-5402-4f60-82ef-6aa2f60edfc7 req-fff3361a-3a32-49e4-89e1-c1931fb32a26 tempest-AttachVolumeTestJSON-1917629784 None] attachment_update completed successfully.
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Flow 'volume_create_manager' (eb6039fb-1d5d-45d1-bb9f-dd962b6b3b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde17da0-69d8-4507-ac5d-5d83b21f276b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde17da0-69d8-4507-ac5d-5d83b21f276b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:30:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-33065175',display_name='tempest-VolumesGetTest-Volume-1564392145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6541e02a-02d3-448d-bbfc-be71c14a1c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf7a660022146e3a2f17e6b6682815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:30:08Z,use_quota=True,user_id='da25d8364f934fa8872aa3701b6424c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45162782-b89d-420d-a8c8-d88ad7bf7f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45162782-b89d-420d-a8c8-d88ad7bf7f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fe781e-98bb-4f03-b67f-097081b526b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fe781e-98bb-4f03-b67f-097081b526b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6541e02a-02d3-448d-bbfc-be71c14a1c51', 'volume_name': 'volume-6541e02a-02d3-448d-bbfc-be71c14a1c51', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2f29c1-3b04-4ac4-8277-f3f2c8b391d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2f29c1-3b04-4ac4-8277-f3f2c8b391d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f33c129-9cf6-46d1-8842-2851d415b3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:08 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Volume 6541e02a-02d3-448d-bbfc-be71c14a1c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6541e02a-02d3-448d-bbfc-be71c14a1c51', 'volume_size': 1}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:30:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-33065175',display_name='tempest-VolumesGetTest-Volume-1564392145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6541e02a-02d3-448d-bbfc-be71c14a1c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf7a660022146e3a2f17e6b6682815c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:30:08Z,use_quota=True,user_id='da25d8364f934fa8872aa3701b6424c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Creating volume 6541e02a-02d3-448d-bbfc-be71c14a1c51 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:30:08 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6541e02a-02d3-448d-bbfc-be71c14a1c51 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:08 devstack sudo[103571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6541e02a-02d3-448d-bbfc-be71c14a1c51 1073741824
Apr 29 10:30:08 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:08 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6541e02a-02d3-448d-bbfc-be71c14a1c51 1073741824" returned: 0 in 0.872s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6541e02a-02d3-448d-bbfc-be71c14a1c51 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:09 devstack sudo[103893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6541e02a-02d3-448d-bbfc-be71c14a1c51
Apr 29 10:30:09 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:09 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6541e02a-02d3-448d-bbfc-be71c14a1c51" returned: 0 in 0.611s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:30:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f33c129-9cf6-46d1-8842-2851d415b3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6541e02a-02d3-448d-bbfc-be71c14a1c51', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c0cacc-2653-4f92-9a45-d2c2dff4c3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:09 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Volume volume-6541e02a-02d3-448d-bbfc-be71c14a1c51 (6541e02a-02d3-448d-bbfc-be71c14a1c51): created successfully
Apr 29 10:30:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c0cacc-2653-4f92-9a45-d2c2dff4c3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Flow 'volume_create_manager' (eb6039fb-1d5d-45d1-bb9f-dd962b6b3b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:30:09 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-859b2ec6-e6a8-435a-8f1c-c6e4b3aeefe7 tempest-VolumesGetTest-350006876 None] Created volume successfully.
Apr 29 10:30:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-6541e02a-02d3-448d-bbfc-be71c14a1c51-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Lock "cinder-6541e02a-02d3-448d-bbfc-be71c14a1c51-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-quobyte-6541e02a-02d3-448d-bbfc-be71c14a1c51" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-6541e02a-02d3-448d-bbfc-be71c14a1c51" acquired by "delete_volume" :: waited 0.014s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:10 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[191e008f-a0d1-4a19-a159-b70913f0f5bf]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6541e02a-02d3-448d-bbfc-be71c14a1c51 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:10 devstack sudo[103896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6541e02a-02d3-448d-bbfc-be71c14a1c51
Apr 29 10:30:10 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:11 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6541e02a-02d3-448d-bbfc-be71c14a1c51" returned: 0 in 0.742s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6541e02a-02d3-448d-bbfc-be71c14a1c51 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:11 devstack sudo[103902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6541e02a-02d3-448d-bbfc-be71c14a1c51
Apr 29 10:30:11 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:11 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6541e02a-02d3-448d-bbfc-be71c14a1c51" returned: 0 in 0.623s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-6541e02a-02d3-448d-bbfc-be71c14a1c51" released by "delete_volume" :: held 1.414s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:11 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Created reservations ['40d0a48a-6c5b-49b2-b7ab-b2356b323606', '882b5230-5b4a-4e1c-97b3-5c3741b977cc', 'a39e37ce-2d20-41c3-b367-707dde57be7d', '13764bcd-a14f-4014-8df9-d4263cfc8674'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:30:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:30:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:30:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:11 devstack sudo[103905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:30:11 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:12 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.717s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:12 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:30:12 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Deleted volume successfully.
Apr 29 10:30:12 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bd1844f4-34b3-4f95-bfa4-8b6cb99467be tempest-VolumesGetTest-350006876 None] Lock "cinder-6541e02a-02d3-448d-bbfc-be71c14a1c51-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:12 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-37269c41-2995-4774-8dd7-2b3af8203cfd-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:12 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Lock "cinder-37269c41-2995-4774-8dd7-2b3af8203cfd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:12 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Acquiring lock "cinder-quobyte-37269c41-2995-4774-8dd7-2b3af8203cfd" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:12 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-37269c41-2995-4774-8dd7-2b3af8203cfd" acquired by "delete_volume" :: waited 0.038s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:12 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[36542c9c-74d7-40f9-a768-635e168ac076]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:13 devstack sudo[103908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd
Apr 29 10:30:13 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Flow 'volume_create_manager' (83e054de-db8c-4eb9-90b5-301d653ca880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ee2d70-6b73-4818-8ecb-e2aa35f35df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ee2d70-6b73-4818-8ecb-e2aa35f35df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1807907936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe98e8a3-a633-47b8-ba64-8e09f09a7ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00d318c9a004d64bce2b22ee45b192e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:30:13Z,use_quota=True,user_id='3afc570f73c94205893b9a803e3e0cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb61aab-058f-4acd-b0bf-9fce1f31b341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb61aab-058f-4acd-b0bf-9fce1f31b341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca933d9-7478-4b66-95dd-7112668db5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca933d9-7478-4b66-95dd-7112668db5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe98e8a3-a633-47b8-ba64-8e09f09a7ff3', 'volume_name': 'volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a8fcd4-38ef-44e8-9d84-34c290330dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a8fcd4-38ef-44e8-9d84-34c290330dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4360ad-9cfd-4585-8fbf-06df42fa94b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:13 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Volume fe98e8a3-a633-47b8-ba64-8e09f09a7ff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3', 'volume_size': 1}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1807907936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe98e8a3-a633-47b8-ba64-8e09f09a7ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00d318c9a004d64bce2b22ee45b192e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:30:13Z,use_quota=True,user_id='3afc570f73c94205893b9a803e3e0cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Creating volume fe98e8a3-a633-47b8-ba64-8e09f09a7ff3 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:30:13 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:13 devstack sudo[103911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3 1073741824
Apr 29 10:30:13 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-7d0d4245-83fb-4096-bb58-702dd919a73d req-5b549d08-762a-4fdf-b78f-a7b42f98bd84 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:14 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd" returned: 0 in 1.118s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:14 devstack sudo[103924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd
Apr 29 10:30:14 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:14 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3 1073741824" returned: 0 in 1.207s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:14 devstack sudo[103930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3
Apr 29 10:30:14 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:14 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd" returned: 1 in 0.944s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:30:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:14 devstack sudo[103935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd
Apr 29 10:30:14 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:15 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3" returned: 0 in 0.664s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-7d0d4245-83fb-4096-bb58-702dd919a73d req-5b549d08-762a-4fdf-b78f-a7b42f98bd84 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.545s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4360ad-9cfd-4585-8fbf-06df42fa94b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83fe920-7252-478a-b064-bb0478e254c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:15 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Volume volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3 (fe98e8a3-a633-47b8-ba64-8e09f09a7ff3): created successfully
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83fe920-7252-478a-b064-bb0478e254c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Flow 'volume_create_manager' (83e054de-db8c-4eb9-90b5-301d653ca880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9e90fa-9658-4c33-93f6-522747a512f6]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-7d0d4245-83fb-4096-bb58-702dd919a73d req-5b549d08-762a-4fdf-b78f-a7b42f98bd84 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:15 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-ea30906e-709e-49f1-9baf-9367d6124e8b tempest-AttachVolumeTestJSON-1917629784 None] Created volume successfully.
Apr 29 10:30:15 devstack sudo[103938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247
Apr 29 10:30:15 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:15 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-37269c41-2995-4774-8dd7-2b3af8203cfd" returned: 0 in 0.752s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Lock "cinder-quobyte-37269c41-2995-4774-8dd7-2b3af8203cfd" released by "delete_volume" :: held 2.925s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Created reservations ['919edb26-ee08-4a41-91f4-7a1f24664cc5', '9a6495b6-4185-4dcf-bfff-5ac7379aa1b5', 'e0005b53-c766-4be9-9d87-e1e8afc827ce', '748037b8-4e06-4802-8bc2-339e8d56eeae'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:15 devstack sudo[103941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:30:15 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:16 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-7d0d4245-83fb-4096-bb58-702dd919a73d req-5b549d08-762a-4fdf-b78f-a7b42f98bd84 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247" returned: 0 in 0.812s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-7d0d4245-83fb-4096-bb58-702dd919a73d req-5b549d08-762a-4fdf-b78f-a7b42f98bd84 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:16 devstack sudo[103946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247
Apr 29 10:30:16 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:16 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.896s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:16 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:30:16 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Deleted volume successfully.
Apr 29 10:30:16 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-06a7a406-437f-461e-b697-05084027cc4f tempest-VolumesGetTest-350006876 None] Lock "cinder-37269c41-2995-4774-8dd7-2b3af8203cfd-delete_volume" released by "delete_volume" :: held 4.103s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:17 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-7d0d4245-83fb-4096-bb58-702dd919a73d req-5b549d08-762a-4fdf-b78f-a7b42f98bd84 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247" returned: 1 in 0.887s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-7d0d4245-83fb-4096-bb58-702dd919a73d req-5b549d08-762a-4fdf-b78f-a7b42f98bd84 tempest-TestInstancesWithCinderVolumes-1374990074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:30:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-7d0d4245-83fb-4096-bb58-702dd919a73d req-5b549d08-762a-4fdf-b78f-a7b42f98bd84 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.794s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-7d0d4245-83fb-4096-bb58-702dd919a73d req-5b549d08-762a-4fdf-b78f-a7b42f98bd84 tempest-TestInstancesWithCinderVolumes-1374990074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-d3997ca0-aad2-4f58-be82-cc15509bb247', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f790ebf1-aae0-4649-a964-776b99d42b29', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:30:17 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-7d0d4245-83fb-4096-bb58-702dd919a73d req-5b549d08-762a-4fdf-b78f-a7b42f98bd84 tempest-TestInstancesWithCinderVolumes-1374990074 None] attachment_update completed successfully.
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Flow 'volume_create_manager' (6922718b-212d-4676-9ba8-fcf415e13c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f81895-e641-4a37-a6d1-7227768312fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f81895-e641-4a37-a6d1-7227768312fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1321743440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84b14d2-b575-458f-bd78-80161ef44f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cde85abda154408819a018b91586c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:30:20Z,use_quota=True,user_id='c371a315a64c47e99a7fe66982663fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2493fd80-85ce-45df-8bdb-71fc6ae8dfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2493fd80-85ce-45df-8bdb-71fc6ae8dfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c6d981-5292-48e0-873e-124b7bc82293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c6d981-5292-48e0-873e-124b7bc82293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a84b14d2-b575-458f-bd78-80161ef44f93', 'volume_name': 'volume-a84b14d2-b575-458f-bd78-80161ef44f93', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee88a81-402a-4471-a392-e20b32dcb797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee88a81-402a-4471-a392-e20b32dcb797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc813069-09cb-4f25-aea5-54d490d93d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:19 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Volume a84b14d2-b575-458f-bd78-80161ef44f93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a84b14d2-b575-458f-bd78-80161ef44f93', 'volume_size': 1}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1321743440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84b14d2-b575-458f-bd78-80161ef44f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cde85abda154408819a018b91586c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:30:20Z,use_quota=True,user_id='c371a315a64c47e99a7fe66982663fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Creating volume a84b14d2-b575-458f-bd78-80161ef44f93 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:30:19 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:19 devstack sudo[103961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93 1073741824
Apr 29 10:30:19 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-b82c0f5f-bea8-46f9-8bcb-121fbc6c2ea7 req-3486fe5a-ddb2-4430-847c-234fc38132ae tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:20 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93 1073741824" returned: 0 in 0.999s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:20 devstack sudo[104008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93
Apr 29 10:30:20 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:21 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93" returned: 0 in 0.630s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:30:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-b82c0f5f-bea8-46f9-8bcb-121fbc6c2ea7 req-3486fe5a-ddb2-4430-847c-234fc38132ae tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.503s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc813069-09cb-4f25-aea5-54d490d93d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a84b14d2-b575-458f-bd78-80161ef44f93', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb12c2e6-9efb-433d-8416-60ef3b924dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:21 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[217e9bce-25b7-4962-b798-e9cc307f8d4c]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-b82c0f5f-bea8-46f9-8bcb-121fbc6c2ea7 req-3486fe5a-ddb2-4430-847c-234fc38132ae tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:21 devstack sudo[104017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3
Apr 29 10:30:21 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:21 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Volume volume-a84b14d2-b575-458f-bd78-80161ef44f93 (a84b14d2-b575-458f-bd78-80161ef44f93): created successfully
Apr 29 10:30:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb12c2e6-9efb-433d-8416-60ef3b924dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Flow 'volume_create_manager' (6922718b-212d-4676-9ba8-fcf415e13c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:30:21 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-56d1417c-7616-428c-a76c-fc073dc39a94 tempest-VolumesSnapshotListTestJSON-233011595 None] Created volume successfully.
Apr 29 10:30:22 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-b82c0f5f-bea8-46f9-8bcb-121fbc6c2ea7 req-3486fe5a-ddb2-4430-847c-234fc38132ae tempest-AttachVolumeTestJSON-1917629784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3" returned: 0 in 0.856s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-b82c0f5f-bea8-46f9-8bcb-121fbc6c2ea7 req-3486fe5a-ddb2-4430-847c-234fc38132ae tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.880s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-b82c0f5f-bea8-46f9-8bcb-121fbc6c2ea7 req-3486fe5a-ddb2-4430-847c-234fc38132ae tempest-AttachVolumeTestJSON-1917629784 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f22d1ff1-2f16-43ed-a654-9f11f937988a', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:30:23 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-b82c0f5f-bea8-46f9-8bcb-121fbc6c2ea7 req-3486fe5a-ddb2-4430-847c-234fc38132ae tempest-AttachVolumeTestJSON-1917629784 None] attachment_update completed successfully.
Apr 29 10:30:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:26 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] Creating offline snapshot 809bae61-f69d-4f72-b5d8-b068364ac57f of volume a84b14d2-b575-458f-bd78-80161ef44f93 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:30:26 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ec438f-27a8-4c4b-8b61-221cb55fc60a]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:27 devstack sudo[104094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93
Apr 29 10:30:27 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:28 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93" returned: 0 in 1.296s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:28 devstack sudo[104128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f 1G
Apr 29 10:30:28 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:29 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f 1G" returned: 0 in 0.984s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a84b14d2-b575-458f-bd78-80161ef44f93 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:29 devstack sudo[104134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a84b14d2-b575-458f-bd78-80161ef44f93 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f
Apr 29 10:30:29 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:30 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a84b14d2-b575-458f-bd78-80161ef44f93 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f" returned: 0 in 0.837s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:30 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f is being set with open permissions: ugo+rw
Apr 29 10:30:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:30 devstack sudo[104140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f
Apr 29 10:30:30 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:30 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f" returned: 0 in 0.929s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:31 devstack sudo[104143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.info
Apr 29 10:30:31 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:31 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.info" returned: 0 in 0.850s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:31 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.info is being set with open permissions: ugo+rw
Apr 29 10:30:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:31 devstack sudo[104151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.info
Apr 29 10:30:31 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:32 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.info" returned: 0 in 0.868s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.991s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:32 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1f888c2a-3206-42bc-b8e5-7956b6d8ca9e tempest-VolumesSnapshotListTestJSON-233011595 None] Create snapshot completed successfully
Apr 29 10:30:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9a5c792c-31b4-46cf-a66b-60a9bd1a104c tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9a5c792c-31b4-46cf-a66b-60a9bd1a104c tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9a5c792c-31b4-46cf-a66b-60a9bd1a104c tempest-VolumesSnapshotListTestJSON-233011595 None] Creating offline snapshot 44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 of volume a84b14d2-b575-458f-bd78-80161ef44f93 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:30:33 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdbecb4-6c4f-4128-a5d9-7041f744a1a9]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c792c-31b4-46cf-a66b-60a9bd1a104c tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:33 devstack sudo[104156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f
Apr 29 10:30:33 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:34 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-312ae07c-b73a-45bb-af61-bf13b120780e req-4aa057f4-9737-4eab-850f-a3dc549cc4b8 tempest-AttachVolumeTestJSON-1917629784 None] Terminate volume connection completed successfully.
Apr 29 10:30:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-312ae07c-b73a-45bb-af61-bf13b120780e req-4aa057f4-9737-4eab-850f-a3dc549cc4b8 tempest-AttachVolumeTestJSON-1917629784 None] Deleting attachment a88e49cd-add5-4512-aefe-1d2a22236080. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:30:35 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c792c-31b4-46cf-a66b-60a9bd1a104c tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f" returned: 0 in 1.311s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9a5c792c-31b4-46cf-a66b-60a9bd1a104c tempest-VolumesSnapshotListTestJSON-233011595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a84b14d2-b575-458f-bd78-80161ef44f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:30:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c792c-31b4-46cf-a66b-60a9bd1a104c tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:35 devstack sudo[104162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 1G
Apr 29 10:30:35 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:36 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c792c-31b4-46cf-a66b-60a9bd1a104c tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 1G" returned: 0 in 1.416s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c792c-31b4-46cf-a66b-60a9bd1a104c tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:36 devstack sudo[104167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87
Apr 29 10:30:36 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:37 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c792c-31b4-46cf-a66b-60a9bd1a104c tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87" returned: 0 in 1.138s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:37 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-9a5c792c-31b4-46cf-a66b-60a9bd1a104c tempest-VolumesSnapshotListTestJSON-233011595 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 is being set with open permissions: ugo+rw
Apr 29 10:30:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c792c-31b4-46cf-a66b-60a9bd1a104c tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:37 devstack sudo[104173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87
Apr 29 10:30:37 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:37 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-1bbff43e-0729-4006-9f22-f5ec2fdb2416 req-08563fa4-8fdd-4fba-ab9f-a592b791211c tempest-AttachVolumeTestJSON-1917629784 None] Terminate volume connection completed successfully.
Apr 29 10:30:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-1bbff43e-0729-4006-9f22-f5ec2fdb2416 req-08563fa4-8fdd-4fba-ab9f-a592b791211c tempest-AttachVolumeTestJSON-1917629784 None] Deleting attachment f22d1ff1-2f16-43ed-a654-9f11f937988a. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:30:38 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9a5c792c-31b4-46cf-a66b-60a9bd1a104c tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87" returned: 0 in 0.992s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9a5c792c-31b4-46cf-a66b-60a9bd1a104c tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.050s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:38 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-9a5c792c-31b4-46cf-a66b-60a9bd1a104c tempest-VolumesSnapshotListTestJSON-233011595 None] Create snapshot completed successfully
Apr 29 10:30:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-51c7b2cb-ff63-4afb-9489-90014a98bdc5 tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-51c7b2cb-ff63-4afb-9489-90014a98bdc5 tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-51c7b2cb-ff63-4afb-9489-90014a98bdc5 tempest-VolumesSnapshotListTestJSON-233011595 None] Creating offline snapshot 0d39e216-a60d-45c8-b806-cddb4cd37610 of volume a84b14d2-b575-458f-bd78-80161ef44f93 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:30:39 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b854423-91d4-4c8f-ae29-8b13adea1ed6]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-51c7b2cb-ff63-4afb-9489-90014a98bdc5 tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:39 devstack sudo[104243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87
Apr 29 10:30:39 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:40 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-51c7b2cb-ff63-4afb-9489-90014a98bdc5 tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87" returned: 0 in 1.125s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:40 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-51c7b2cb-ff63-4afb-9489-90014a98bdc5 tempest-VolumesSnapshotListTestJSON-233011595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a84b14d2-b575-458f-bd78-80161ef44f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:30:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-51c7b2cb-ff63-4afb-9489-90014a98bdc5 tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:40 devstack sudo[104248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610 1G
Apr 29 10:30:40 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:41 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-51c7b2cb-ff63-4afb-9489-90014a98bdc5 tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610 1G" returned: 0 in 1.001s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-51c7b2cb-ff63-4afb-9489-90014a98bdc5 tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:41 devstack sudo[104260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610
Apr 29 10:30:41 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:42 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-51c7b2cb-ff63-4afb-9489-90014a98bdc5 tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610" returned: 0 in 0.791s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:42 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-51c7b2cb-ff63-4afb-9489-90014a98bdc5 tempest-VolumesSnapshotListTestJSON-233011595 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610 is being set with open permissions: ugo+rw
Apr 29 10:30:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-51c7b2cb-ff63-4afb-9489-90014a98bdc5 tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:42 devstack sudo[104296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610
Apr 29 10:30:42 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:43 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-51c7b2cb-ff63-4afb-9489-90014a98bdc5 tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610" returned: 0 in 0.763s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-51c7b2cb-ff63-4afb-9489-90014a98bdc5 tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.825s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:43 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-51c7b2cb-ff63-4afb-9489-90014a98bdc5 tempest-VolumesSnapshotListTestJSON-233011595 None] Create snapshot completed successfully
Apr 29 10:30:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "cinder-0d39e216-a60d-45c8-b806-cddb4cd37610-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-0d39e216-a60d-45c8-b806-cddb4cd37610-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "cinder-quobyte-a84b14d2-b575-458f-bd78-80161ef44f93" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-quobyte-a84b14d2-b575-458f-bd78-80161ef44f93" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "cinder-quobyte-0d39e216-a60d-45c8-b806-cddb4cd37610" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-quobyte-0d39e216-a60d-45c8-b806-cddb4cd37610" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Deleting offline snapshot 0d39e216-a60d-45c8-b806-cddb4cd37610 of volume a84b14d2-b575-458f-bd78-80161ef44f93 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:30:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] snapshot_file for this snap is: volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:30:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd1fa47-6c94-4c37-8d11-125eb686e246]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:44 devstack sudo[104304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610
Apr 29 10:30:44 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:45 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610" returned: 0 in 0.842s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a84b14d2-b575-458f-bd78-80161ef44f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:30:45 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60ca5d0-831b-41ff-a72f-02cb161e6b8b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:45 devstack sudo[104309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87
Apr 29 10:30:45 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:46 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87" returned: 0 in 0.743s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a84b14d2-b575-458f-bd78-80161ef44f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:30:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:46 devstack sudo[104314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610
Apr 29 10:30:46 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:47 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610" returned: 0 in 1.029s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:47 devstack sudo[104320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610
Apr 29 10:30:47 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:47 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.0d39e216-a60d-45c8-b806-cddb4cd37610" returned: 0 in 0.702s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-quobyte-0d39e216-a60d-45c8-b806-cddb4cd37610" released by "_delete_snapshot" :: held 3.507s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-quobyte-a84b14d2-b575-458f-bd78-80161ef44f93" released by "delete_snapshot" :: held 3.538s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:48 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Created reservations ['ea4a2102-7432-44a5-bb51-18ceeca65c9e', 'f8904e9d-6d00-4df9-82df-44af77d03afe', '7b0e9acc-9e81-42d7-929b-dea76d3e1e46', '5beb3460-7349-4f3d-a363-e48790691168'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:30:48 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Delete snapshot completed successfully.
Apr 29 10:30:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3a8b09fa-2e9e-4bbd-9a9b-1575278fbe0b tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-0d39e216-a60d-45c8-b806-cddb4cd37610-delete_snapshot" released by "delete_snapshot" :: held 3.748s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "cinder-44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "cinder-quobyte-a84b14d2-b575-458f-bd78-80161ef44f93" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-quobyte-a84b14d2-b575-458f-bd78-80161ef44f93" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "cinder-quobyte-44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-quobyte-44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Deleting offline snapshot 44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 of volume a84b14d2-b575-458f-bd78-80161ef44f93 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:30:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] snapshot_file for this snap is: volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:30:48 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d664df8-a686-48d3-9d5a-90f57cd2d672]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:49 devstack sudo[104323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87
Apr 29 10:30:49 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "cinder-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Lock "cinder-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "cinder-quobyte-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Lock "cinder-quobyte-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:49 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b32b513-8373-47c7-8184-7147b034d247]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:49 devstack sudo[104325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3
Apr 29 10:30:49 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:49 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87" returned: 0 in 0.847s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a84b14d2-b575-458f-bd78-80161ef44f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:30:49 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3434ca-a237-409f-ab66-07653093eddf]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:50 devstack sudo[104330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f
Apr 29 10:30:50 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:50 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3" returned: 0 in 0.989s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:50 devstack sudo[104336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3
Apr 29 10:30:50 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:50 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f" returned: 0 in 0.842s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:50 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a84b14d2-b575-458f-bd78-80161ef44f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:30:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:50 devstack sudo[104341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87
Apr 29 10:30:50 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:50 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3" returned: 0 in 0.645s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:50 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Lock "cinder-quobyte-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3" released by "delete_volume" :: held 1.694s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:51 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Created reservations ['4328f423-1aa8-458f-a54a-005b783acfe0', '391c131c-1558-4808-9c35-7e3d9e276901', 'fb505362-e7e7-481a-b726-fcb0026f32d8', '03cfc133-2f0e-4220-8c5c-ee5d51f41477'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:30:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:30:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:30:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:51 devstack sudo[104344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:30:51 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "cinder-fb8addca-8d6d-4f7d-8ecb-be4a72639b25-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Lock "cinder-fb8addca-8d6d-4f7d-8ecb-be4a72639b25-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "cinder-quobyte-fb8addca-8d6d-4f7d-8ecb-be4a72639b25" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Lock "cinder-quobyte-fb8addca-8d6d-4f7d-8ecb-be4a72639b25" acquired by "delete_volume" :: waited 0.053s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:51 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4101682b-cd33-4b97-8ab6-8bb9d2d63e4a]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:51 devstack sudo[104354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25
Apr 29 10:30:51 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:51 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87" returned: 0 in 1.244s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:52 devstack sudo[104357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87
Apr 29 10:30:52 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:52 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.037s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:52 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:30:52 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Deleted volume successfully.
Apr 29 10:30:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-482dc0e7-7f43-4a71-ab32-cb791c78e115 tempest-AttachVolumeTestJSON-1917629784 None] Lock "cinder-fe98e8a3-a633-47b8-ba64-8e09f09a7ff3-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:52 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87" returned: 0 in 0.688s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:52 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25" returned: 0 in 1.018s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-quobyte-44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87" released by "_delete_snapshot" :: held 3.899s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-quobyte-a84b14d2-b575-458f-bd78-80161ef44f93" released by "delete_snapshot" :: held 3.946s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:52 devstack sudo[104364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25
Apr 29 10:30:52 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:52 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Created reservations ['9db83929-d178-475c-b9bb-fd679e3964b7', '9eb4dc4c-20b5-40b0-9579-28a7fab3e570', 'f65d0fda-368d-44ee-af6d-56c590511611', 'ba6fa2f5-cff6-4910-8c01-426644b2be8a'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:30:52 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Delete snapshot completed successfully.
Apr 29 10:30:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8ae1e652-9eb8-4dc7-bd55-2c8b1c2265d7 tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-44dd12e6-6c38-4a7b-ab7a-b81fa0c45c87-delete_snapshot" released by "delete_snapshot" :: held 4.091s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "cinder-809bae61-f69d-4f72-b5d8-b068364ac57f-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-809bae61-f69d-4f72-b5d8-b068364ac57f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "cinder-quobyte-a84b14d2-b575-458f-bd78-80161ef44f93" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-quobyte-a84b14d2-b575-458f-bd78-80161ef44f93" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "cinder-quobyte-809bae61-f69d-4f72-b5d8-b068364ac57f" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-quobyte-809bae61-f69d-4f72-b5d8-b068364ac57f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Deleting offline snapshot 809bae61-f69d-4f72-b5d8-b068364ac57f of volume a84b14d2-b575-458f-bd78-80161ef44f93 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] snapshot_file for this snap is: volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce25c584-1a81-4123-ba60-ff52268aeb5b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:53 devstack sudo[104366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f
Apr 29 10:30:53 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:53 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fb8addca-8d6d-4f7d-8ecb-be4a72639b25" returned: 0 in 0.653s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Lock "cinder-quobyte-fb8addca-8d6d-4f7d-8ecb-be4a72639b25" released by "delete_volume" :: held 1.742s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Created reservations ['2acb6e20-2fd2-4456-99ae-bc47e4712326', 'a325aa03-c463-43ba-a75a-8c11c86d9ed9', 'a64e3623-b1c0-4307-a9fa-209e911bcaf5', 'd461b3d8-c6a6-41f4-a15f-af5c83b5f221'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:53 devstack sudo[104370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:30:53 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "cinder-c83168d6-49ee-4a5f-bbcc-47ee668cc988-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Lock "cinder-c83168d6-49ee-4a5f-bbcc-47ee668cc988-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "cinder-quobyte-c83168d6-49ee-4a5f-bbcc-47ee668cc988" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Lock "cinder-quobyte-c83168d6-49ee-4a5f-bbcc-47ee668cc988" acquired by "delete_volume" :: waited 0.032s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:54 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d6c4e8-4eb6-4d18-8234-5df333401cc8]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:54 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f" returned: 0 in 1.074s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a84b14d2-b575-458f-bd78-80161ef44f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:30:54 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1dce23-7412-4d8d-b5c3-41d7e8e3b735]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:54 devstack sudo[104375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988
Apr 29 10:30:54 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:54 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.988s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:54 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:30:54 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Deleted volume successfully.
Apr 29 10:30:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-cb43e454-6c90-4595-ba0f-3a5ce1892e62 tempest-AttachVolumeTestJSON-1917629784 None] Lock "cinder-fb8addca-8d6d-4f7d-8ecb-be4a72639b25-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:54 devstack sudo[104377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93
Apr 29 10:30:54 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-b17d78cb-e695-4026-a01e-75ef44f89176 req-b3e40044-2b6e-4308-ac5c-e1b560136f03 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-b17d78cb-e695-4026-a01e-75ef44f89176 req-b3e40044-2b6e-4308-ac5c-e1b560136f03 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:55 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff25978-3b95-4816-b7df-a6f3ff0ca4ad]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-b17d78cb-e695-4026-a01e-75ef44f89176 req-b3e40044-2b6e-4308-ac5c-e1b560136f03 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8f690aaf-4f07-4891-8346-558afc825dbd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:55 devstack sudo[104391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8f690aaf-4f07-4891-8346-558afc825dbd
Apr 29 10:30:55 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:55 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988" returned: 0 in 0.945s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:55 devstack sudo[104393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988
Apr 29 10:30:55 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:55 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93" returned: 0 in 1.125s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:55 devstack sudo[104398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f
Apr 29 10:30:55 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:55 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-b17d78cb-e695-4026-a01e-75ef44f89176 req-b3e40044-2b6e-4308-ac5c-e1b560136f03 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8f690aaf-4f07-4891-8346-558afc825dbd" returned: 0 in 0.950s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-b17d78cb-e695-4026-a01e-75ef44f89176 req-b3e40044-2b6e-4308-ac5c-e1b560136f03 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.973s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:56 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c83168d6-49ee-4a5f-bbcc-47ee668cc988" returned: 0 in 0.815s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Lock "cinder-quobyte-c83168d6-49ee-4a5f-bbcc-47ee668cc988" released by "delete_volume" :: held 1.830s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:56 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-b17d78cb-e695-4026-a01e-75ef44f89176 req-b3e40044-2b6e-4308-ac5c-e1b560136f03 tempest-TestInstancesWithCinderVolumes-1374990074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-8f690aaf-4f07-4891-8346-558afc825dbd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71d1c406-b915-49fd-a8f4-6dbf0c0dc3b1', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:30:56 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Created reservations ['46817d7e-d9a3-4766-9563-8024b150665c', '00209ba0-294c-47ea-b407-e4540c173220', 'd5d43bb5-fddd-4385-a4e5-f92c9cf71ef5', '3a0a03a3-8828-4776-9c8d-e7f5e74e7d22'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:30:56 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-b17d78cb-e695-4026-a01e-75ef44f89176 req-b3e40044-2b6e-4308-ac5c-e1b560136f03 tempest-TestInstancesWithCinderVolumes-1374990074 None] attachment_update completed successfully.
Apr 29 10:30:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:30:56 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:30:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:56 devstack sudo[104407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:30:56 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:56 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f" returned: 0 in 0.972s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:56 devstack sudo[104409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f
Apr 29 10:30:56 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:57 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.931s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:57 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:30:57 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Deleted volume successfully.
Apr 29 10:30:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-39e26c0a-dc88-44dc-935d-4b3525b0c737 tempest-AttachVolumeTestJSON-1917629784 None] Lock "cinder-c83168d6-49ee-4a5f-bbcc-47ee668cc988-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:57 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93.809bae61-f69d-4f72-b5d8-b068364ac57f" returned: 0 in 0.892s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-quobyte-809bae61-f69d-4f72-b5d8-b068364ac57f" released by "_delete_snapshot" :: held 4.227s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-quobyte-a84b14d2-b575-458f-bd78-80161ef44f93" released by "delete_snapshot" :: held 4.254s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:57 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Created reservations ['3e3d5624-995f-4872-b3c4-16d54a5716ed', 'ce3c4859-32a3-427e-a6d7-b2466e56c5fd', '7d46ff7a-789f-441b-9ad5-52b0c68cd6fe', '677af4ea-c5f8-4916-9ec5-f1dd3a859398'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:30:57 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Delete snapshot completed successfully.
Apr 29 10:30:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-65129250-aaa3-498e-b479-794a2f083bca tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-809bae61-f69d-4f72-b5d8-b068364ac57f-delete_snapshot" released by "delete_snapshot" :: held 4.432s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:30:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "cinder-a84b14d2-b575-458f-bd78-80161ef44f93-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-a84b14d2-b575-458f-bd78-80161ef44f93-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "cinder-quobyte-a84b14d2-b575-458f-bd78-80161ef44f93" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:30:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-quobyte-a84b14d2-b575-458f-bd78-80161ef44f93" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:30:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5c1189-b73f-4d13-bbc4-abe15a4fe933]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:30:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:58 devstack sudo[104416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93
Apr 29 10:30:58 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:59 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93" returned: 0 in 0.876s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:30:59 devstack sudo[104421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93
Apr 29 10:30:59 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Flow 'volume_create_manager' (f9beb6c9-a020-45fe-bd66-12c52887c698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d5f79e8-eaa7-41e9-b164-7b083b3becf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d5f79e8-eaa7-41e9-b164-7b083b3becf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-719486695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c987ba6-f88d-4863-bec4-8e07f8013817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020a37433277455ab0e2d2ef4b3d87cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:00Z,use_quota=True,user_id='fc9917f93edd4876b13b4595aeea7140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9595419-641f-44ca-8e16-9095c3c257b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9595419-641f-44ca-8e16-9095c3c257b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c34114f-0c2d-43eb-ae0b-e007e0766535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c34114f-0c2d-43eb-ae0b-e007e0766535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c987ba6-f88d-4863-bec4-8e07f8013817', 'volume_name': 'volume-3c987ba6-f88d-4863-bec4-8e07f8013817', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73aab44-99e7-4ccf-b6a5-6137c8e56e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73aab44-99e7-4ccf-b6a5-6137c8e56e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203a51f4-826e-48bf-b51e-79c6f9cf51ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:30:59 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Volume 3c987ba6-f88d-4863-bec4-8e07f8013817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c987ba6-f88d-4863-bec4-8e07f8013817', 'volume_size': 1}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-719486695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c987ba6-f88d-4863-bec4-8e07f8013817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020a37433277455ab0e2d2ef4b3d87cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:00Z,use_quota=True,user_id='fc9917f93edd4876b13b4595aeea7140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Creating volume 3c987ba6-f88d-4863-bec4-8e07f8013817 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:30:59 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:30:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c987ba6-f88d-4863-bec4-8e07f8013817 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:00 devstack sudo[104423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c987ba6-f88d-4863-bec4-8e07f8013817 1073741824
Apr 29 10:31:00 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:00 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:31:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Flow 'volume_create_manager' (100dace2-67d8-4daa-af7b-bcb57f8e7765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:31:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee600705-f774-41c1-96e0-91e67cb27397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee600705-f774-41c1-96e0-91e67cb27397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1855132235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020a37433277455ab0e2d2ef4b3d87cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:01Z,use_quota=True,user_id='fc9917f93edd4876b13b4595aeea7140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8622fb-9c62-4360-8fe5-0fa3fae67d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8622fb-9c62-4360-8fe5-0fa3fae67d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f553dc-6871-4d02-92d7-f4a416b46998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f553dc-6871-4d02-92d7-f4a416b46998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2', 'volume_name': 'volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52086892-7daa-4713-bdcf-548150a78dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52086892-7daa-4713-bdcf-548150a78dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3b0f5a-779c-43df-b4ca-e8fe36e1643b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:00 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Volume 5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2', 'volume_size': 1}
Apr 29 10:31:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:01 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a84b14d2-b575-458f-bd78-80161ef44f93" returned: 0 in 1.524s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-quobyte-a84b14d2-b575-458f-bd78-80161ef44f93" released by "delete_volume" :: held 2.509s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:01 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Created reservations ['b5d88e82-2721-48d4-8383-20ef033362ac', 'ed6cc4de-afc9-4e08-a819-0a07d0498065', '5de36768-77a9-4a8a-8874-9bb04da0d178', 'edf229fc-c093-4bbe-a3bb-386046fa059d'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:31:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:31:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:31:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:01 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c987ba6-f88d-4863-bec4-8e07f8013817 1073741824" returned: 0 in 1.503s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:01 devstack sudo[104436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:31:01 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c987ba6-f88d-4863-bec4-8e07f8013817 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:01 devstack sudo[104438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c987ba6-f88d-4863-bec4-8e07f8013817
Apr 29 10:31:01 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:02 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.962s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:31:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Deleted volume successfully.
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2d3a754-a174-49a6-b2a1-8bb89c96ad5c tempest-VolumesSnapshotListTestJSON-233011595 None] Lock "cinder-a84b14d2-b575-458f-bd78-80161ef44f93-delete_volume" released by "delete_volume" :: held 3.847s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:02 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c987ba6-f88d-4863-bec4-8e07f8013817" returned: 0 in 1.141s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] <== create_volume: return (2733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.737s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.830s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1855132235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020a37433277455ab0e2d2ef4b3d87cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:01Z,use_quota=True,user_id='fc9917f93edd4876b13b4595aeea7140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Creating volume 5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:31:02 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203a51f4-826e-48bf-b51e-79c6f9cf51ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c987ba6-f88d-4863-bec4-8e07f8013817', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56bbbed-ba4d-4050-af1d-971343e37b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:02 devstack sudo[104443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2 1073741824
Apr 29 10:31:02 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:02 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Volume volume-3c987ba6-f88d-4863-bec4-8e07f8013817 (3c987ba6-f88d-4863-bec4-8e07f8013817): created successfully
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56bbbed-ba4d-4050-af1d-971343e37b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Flow 'volume_create_manager' (f9beb6c9-a020-45fe-bd66-12c52887c698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:31:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-342895e1-27b8-43ec-883e-c24d950e4b6a tempest-TestServerVolumeAttachmentScenario-1170700729 None] Created volume successfully.
Apr 29 10:31:04 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2 1073741824" returned: 0 in 1.429s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:04 devstack sudo[104457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2
Apr 29 10:31:04 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-dc3a96fb-f149-4954-a536-9d7aa34d151d req-2f6d0fe8-b364-4475-8e73-3e23a1fa3452 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:05 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2" returned: 0 in 0.883s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] <== create_volume: return (2389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.393s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-dc3a96fb-f149-4954-a536-9d7aa34d151d req-2f6d0fe8-b364-4475-8e73-3e23a1fa3452 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.800s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3b0f5a-779c-43df-b4ca-e8fe36e1643b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2d7d96-fe47-4d86-a221-f821fa9ace4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ef6ed2-fde0-45e2-a86e-a8abbd012f36]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=87,cinder:INSERT=25,cinder:UPDATE=101,cinder:DELETE=4 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-dc3a96fb-f149-4954-a536-9d7aa34d151d req-2f6d0fe8-b364-4475-8e73-3e23a1fa3452 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:05 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Volume volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2 (5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2): created successfully
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2d7d96-fe47-4d86-a221-f821fa9ace4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Flow 'volume_create_manager' (100dace2-67d8-4daa-af7b-bcb57f8e7765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:31:05 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-9c1de43d-15b1-4867-ac53-3ce19e79b6a4 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Created volume successfully.
Apr 29 10:31:05 devstack sudo[104460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5
Apr 29 10:31:05 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:05 devstack sudo[104462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:31:05 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:06 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-dc3a96fb-f149-4954-a536-9d7aa34d151d req-2f6d0fe8-b364-4475-8e73-3e23a1fa3452 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5" returned: 0 in 1.075s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-dc3a96fb-f149-4954-a536-9d7aa34d151d req-2f6d0fe8-b364-4475-8e73-3e23a1fa3452 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.118s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-dc3a96fb-f149-4954-a536-9d7aa34d151d req-2f6d0fe8-b364-4475-8e73-3e23a1fa3452 tempest-TestInstancesWithCinderVolumes-1374990074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2d84375-d07e-4195-b4a7-4730b6d05e23', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:31:06 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=105,cinder:INSERT=29,cinder:UPDATE=82,cinder:DELETE=11 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:31:06 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-dc3a96fb-f149-4954-a536-9d7aa34d151d req-2f6d0fe8-b364-4475-8e73-3e23a1fa3452 tempest-TestInstancesWithCinderVolumes-1374990074 None] attachment_update completed successfully.
Apr 29 10:31:06 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.997s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Flow 'volume_create_manager' (7001364c-1aaa-46b1-bb0b-5c2331d6a531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5b2c77-afa7-4c1f-aa15-8bffa1bd128b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5b2c77-afa7-4c1f-aa15-8bffa1bd128b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1293347621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7da93e-cfb1-4a5d-8677-5d07c425b66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd0e418810a4a65933223512479b8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:07Z,use_quota=True,user_id='fb2de558e9ca4968b6f34e041d51771f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647dc6f4-20d9-4913-8565-e8e4e275e8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647dc6f4-20d9-4913-8565-e8e4e275e8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9e7367-d069-4771-a33e-5452e9d9e86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9e7367-d069-4771-a33e-5452e9d9e86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7da93e-cfb1-4a5d-8677-5d07c425b66f', 'volume_name': 'volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c51459d-22cb-4eef-9c8d-d07c05044d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c51459d-22cb-4eef-9c8d-d07c05044d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8282291a-1920-4a7e-9a60-cb90d941c608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:07 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Volume ed7da93e-cfb1-4a5d-8677-5d07c425b66f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f', 'volume_size': 1}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1293347621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7da93e-cfb1-4a5d-8677-5d07c425b66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd0e418810a4a65933223512479b8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:07Z,use_quota=True,user_id='fb2de558e9ca4968b6f34e041d51771f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Creating volume ed7da93e-cfb1-4a5d-8677-5d07c425b66f {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:31:07 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:31:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:07 devstack sudo[104471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f 1073741824
Apr 29 10:31:07 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:08 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f 1073741824" returned: 0 in 0.941s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:08 devstack sudo[104478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f
Apr 29 10:31:08 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:08 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f" returned: 0 in 0.622s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:31:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8282291a-1920-4a7e-9a60-cb90d941c608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9be855d-4a29-4667-83eb-c4879bcb54c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:08 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Volume volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f (ed7da93e-cfb1-4a5d-8677-5d07c425b66f): created successfully
Apr 29 10:31:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9be855d-4a29-4667-83eb-c4879bcb54c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Flow 'volume_create_manager' (7001364c-1aaa-46b1-bb0b-5c2331d6a531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:31:09 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c3c15696-1529-4ea2-8da6-7cc203a61d21 tempest-VolumeDependencyTests-368492578 None] Created volume successfully.
Apr 29 10:31:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] Creating offline snapshot fe5b1543-95c7-4308-acf6-0274df2d5b69 of volume ed7da93e-cfb1-4a5d-8677-5d07c425b66f {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:31:09 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9faeb36-ac9c-4668-9fd0-860385bf0efb]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:09 devstack sudo[104481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f
Apr 29 10:31:09 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:10 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f" returned: 0 in 0.828s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:10 devstack sudo[104489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69 1G
Apr 29 10:31:10 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:11 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69 1G" returned: 0 in 1.130s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:11 devstack sudo[104501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69
Apr 29 10:31:11 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:12 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69" returned: 0 in 1.072s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:12 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69 is being set with open permissions: ugo+rw
Apr 29 10:31:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:12 devstack sudo[104509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69
Apr 29 10:31:12 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:13 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69" returned: 0 in 0.829s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:13 devstack sudo[104533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.info
Apr 29 10:31:13 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:14 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.info" returned: 0 in 0.758s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:14 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.info is being set with open permissions: ugo+rw
Apr 29 10:31:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:14 devstack sudo[104552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.info
Apr 29 10:31:14 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:15 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.info" returned: 0 in 0.703s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.418s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:15 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-b6341f5e-9982-4992-821c-b63d7fa8fc6c tempest-VolumeDependencyTests-368492578 None] Create snapshot completed successfully
Apr 29 10:31:16 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-34b6b58b-23fa-4536-b82a-a13e982508d0 req-b37767e5-6c87-4a93-87b4-87b3436bc741 tempest-TestInstancesWithCinderVolumes-1374990074 None] Terminate volume connection completed successfully.
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-34b6b58b-23fa-4536-b82a-a13e982508d0 req-b37767e5-6c87-4a93-87b4-87b3436bc741 tempest-TestInstancesWithCinderVolumes-1374990074 None] Deleting attachment 71d1c406-b915-49fd-a8f4-6dbf0c0dc3b1. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Flow 'volume_create_manager' (f06d8e20-baf3-43a4-8e35-b87c5530c027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ff8302-5ca9-42a8-be57-9e9c33edb80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ff8302-5ca9-42a8-be57-9e9c33edb80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1958908335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=067a5fdc-9ec7-4be3-8949-aaa695c28f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd0e418810a4a65933223512479b8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe5b1543-95c7-4308-acf6-0274df2d5b69,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:16Z,use_quota=True,user_id='fb2de558e9ca4968b6f34e041d51771f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c65dd2c-0402-4f3a-a7b3-646e04b6c55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c65dd2c-0402-4f3a-a7b3-646e04b6c55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cc1037-84dd-46c0-9688-eab423188578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cc1037-84dd-46c0-9688-eab423188578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '067a5fdc-9ec7-4be3-8949-aaa695c28f45', 'volume_name': 'volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45', 'volume_size': 1, 'snapshot_id': 'fe5b1543-95c7-4308-acf6-0274df2d5b69'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa783db-725f-46fa-b38b-86903c3d49f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa783db-725f-46fa-b38b-86903c3d49f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88499eff-3bac-471e-838b-3a64c3990aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:16 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Volume 067a5fdc-9ec7-4be3-8949-aaa695c28f45: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45', 'volume_size': 1, 'snapshot_id': 'fe5b1543-95c7-4308-acf6-0274df2d5b69'}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "cinder-quobyte-fe5b1543-95c7-4308-acf6-0274df2d5b69-067a5fdc-9ec7-4be3-8949-aaa695c28f45" by "_create_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-fe5b1543-95c7-4308-acf6-0274df2d5b69-067a5fdc-9ec7-4be3-8949-aaa695c28f45" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Creating volume 067a5fdc-9ec7-4be3-8949-aaa695c28f45 from snapshot fe5b1543-95c7-4308-acf6-0274df2d5b69 {{(pid=84165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "cinder-quobyte-067a5fdc-9ec7-4be3-8949-aaa695c28f45" by "_copy_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-067a5fdc-9ec7-4be3-8949-aaa695c28f45" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] snapshot: fe5b1543-95c7-4308-acf6-0274df2d5b69, volume: 067a5fdc-9ec7-4be3-8949-aaa695c28f45,  {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e5fe61-b0ad-4594-a0e7-9db9026a633b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:16 devstack sudo[104561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69
Apr 29 10:31:16 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:17 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69" returned: 0 in 0.802s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:17 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:31:17 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 10:31:17 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Creating direct copy from snapshot {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 10:31:17 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[344fc198-8658-48c5-98ad-dbe4936af184]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:17 devstack sudo[104566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f
Apr 29 10:31:17 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "cinder-8f690aaf-4f07-4891-8346-558afc825dbd-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:31:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "cinder-8f690aaf-4f07-4891-8346-558afc825dbd-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:31:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "cinder-quobyte-8f690aaf-4f07-4891-8346-558afc825dbd" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:31:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "cinder-quobyte-8f690aaf-4f07-4891-8346-558afc825dbd" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:31:18 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f69fac-9953-4227-8a16-6d8cd56512b8]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8f690aaf-4f07-4891-8346-558afc825dbd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:18 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f" returned: 0 in 1.053s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:18 devstack cinder-volume[84165]: DEBUG cinder.utils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Path /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45 not found in is_blk_device check {{(pid=84165) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 10:31:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:18 devstack sudo[104621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45
Apr 29 10:31:18 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:18 devstack sudo[104620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8f690aaf-4f07-4891-8346-558afc825dbd
Apr 29 10:31:18 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:20 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8f690aaf-4f07-4891-8346-558afc825dbd" returned: 0 in 1.939s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8f690aaf-4f07-4891-8346-558afc825dbd {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:20 devstack sudo[104661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8f690aaf-4f07-4891-8346-558afc825dbd
Apr 29 10:31:20 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:22 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8f690aaf-4f07-4891-8346-558afc825dbd" returned: 0 in 1.845s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:22 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "cinder-quobyte-8f690aaf-4f07-4891-8346-558afc825dbd" released by "delete_volume" :: held 3.923s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:22 devstack cinder-volume[84165]: WARNING cinder.quota [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-673521468-504247750 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-673521468-504247750, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:31:22 devstack cinder-volume[84165]: WARNING cinder.quota [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-673521468-504247750 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-673521468-504247750, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:31:22 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Created reservations ['600247d8-4e27-4395-96e8-50da274ae9d1', '8627b77f-9c9d-4525-934e-f26947e3fb9a', '90e0915c-4390-46c9-a1f8-d70bcd3d00e0', '44d10380-f8f6-4d7e-9e36-94e9c35082a4'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:31:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:31:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:31:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:22 devstack sudo[104710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:31:22 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:24 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 2.022s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:24 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:31:24 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Deleted volume successfully.
Apr 29 10:31:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-58aaf44d-6f1e-4311-ac69-075b5983c0e3 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "cinder-8f690aaf-4f07-4891-8346-558afc825dbd-delete_volume" released by "delete_volume" :: held 6.488s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:26 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45" returned: 0 in 7.498s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:26 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9e4e3f-7ab4-410c-b8c6-c702a59e977f]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:26 devstack sudo[104734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f
Apr 29 10:31:26 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:27 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-fbbac706-0f88-4db2-bd4c-2af3afb0eda3 req-fdb01ed3-f924-4383-8a28-6cf433c18660 tempest-TestInstancesWithCinderVolumes-1374990074 None] Terminate volume connection completed successfully.
Apr 29 10:31:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-fbbac706-0f88-4db2-bd4c-2af3afb0eda3 req-fdb01ed3-f924-4383-8a28-6cf433c18660 tempest-TestInstancesWithCinderVolumes-1374990074 None] Deleting attachment d2d84375-d07e-4195-b4a7-4730b6d05e23. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:31:27 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f" returned: 0 in 1.586s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:27 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f, size 1024.00 MB, duration 7.50 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:31:27 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Converted 1024.00 MB image at 136.56 MB/s
Apr 29 10:31:27 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45 is being set with open permissions: ugo+rw
Apr 29 10:31:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:27 devstack sudo[104747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45
Apr 29 10:31:27 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:28 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45" returned: 0 in 0.809s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-067a5fdc-9ec7-4be3-8949-aaa695c28f45" released by "_copy_volume_from_snapshot" :: held 11.867s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-fe5b1543-95c7-4308-acf6-0274df2d5b69-067a5fdc-9ec7-4be3-8949-aaa695c28f45" released by "_create_volume_from_snapshot" :: held 11.908s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.928s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88499eff-3bac-471e-838b-3a64c3990aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45', 'volume_size': 1, 'snapshot_id': 'fe5b1543-95c7-4308-acf6-0274df2d5b69'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ace7de-b1eb-43fd-9511-7a19fa675485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:28 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Volume volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45 (067a5fdc-9ec7-4be3-8949-aaa695c28f45): created successfully
Apr 29 10:31:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ace7de-b1eb-43fd-9511-7a19fa675485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Flow 'volume_create_manager' (f06d8e20-baf3-43a4-8e35-b87c5530c027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:31:28 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5056e5df-d576-42d2-a7ab-8244ce6cfa41 tempest-VolumeDependencyTests-368492578 None] Created volume successfully.
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "cinder-fe5b1543-95c7-4308-acf6-0274df2d5b69-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-fe5b1543-95c7-4308-acf6-0274df2d5b69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "cinder-quobyte-ed7da93e-cfb1-4a5d-8677-5d07c425b66f" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-ed7da93e-cfb1-4a5d-8677-5d07c425b66f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "cinder-quobyte-fe5b1543-95c7-4308-acf6-0274df2d5b69" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-fe5b1543-95c7-4308-acf6-0274df2d5b69" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Deleting offline snapshot fe5b1543-95c7-4308-acf6-0274df2d5b69 of volume ed7da93e-cfb1-4a5d-8677-5d07c425b66f {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] snapshot_file for this snap is: volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[799493e6-1801-436c-9f16-b95dc9174510]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:29 devstack sudo[104752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69
Apr 29 10:31:29 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "cinder-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "cinder-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "cinder-quobyte-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "cinder-quobyte-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5" acquired by "delete_volume" :: waited 0.026s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d34d0b-b23d-4abb-a0ea-34c3a2b7a12e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:30 devstack sudo[104754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5
Apr 29 10:31:30 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:30 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69" returned: 0 in 1.424s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:31:30 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba662f8-10fc-4eba-9f75-914277aa9e9d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:30 devstack sudo[104760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f
Apr 29 10:31:30 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:30 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5" returned: 0 in 1.020s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:31 devstack sudo[104764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5
Apr 29 10:31:31 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:32 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f" returned: 0 in 1.359s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:32 devstack sudo[104775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69
Apr 29 10:31:32 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:32 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5" returned: 0 in 1.347s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "cinder-quobyte-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5" released by "delete_volume" :: held 2.461s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:32 devstack cinder-volume[84165]: WARNING cinder.quota [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1162913341-1586470124 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1162913341-1586470124, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:31:32 devstack cinder-volume[84165]: WARNING cinder.quota [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1162913341-1586470124 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1162913341-1586470124, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:31:32 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Created reservations ['177e6a58-0002-4bb6-9c83-06a996519b94', 'ce8ca2f0-17c6-4a3a-99d4-62bf6595956f', '4f85c8fb-ee7a-4d84-aadc-d1ef6bbf21e9', '6cf807b4-3440-43ee-acfa-7b9c212e7726'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:31:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:31:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:31:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:32 devstack sudo[104777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:31:32 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:33 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69" returned: 0 in 1.022s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:33 devstack sudo[104782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69
Apr 29 10:31:33 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:33 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.144s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:33 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:31:33 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Deleted volume successfully.
Apr 29 10:31:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-24911653-0ba8-4520-bd14-2e5c9bc5f8d7 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "cinder-cb858f7a-25b0-4b9d-9d64-38e1b7f56ce5-delete_volume" released by "delete_volume" :: held 4.036s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:34 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f.fe5b1543-95c7-4308-acf6-0274df2d5b69" returned: 0 in 1.117s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-fe5b1543-95c7-4308-acf6-0274df2d5b69" released by "_delete_snapshot" :: held 5.107s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-ed7da93e-cfb1-4a5d-8677-5d07c425b66f" released by "delete_snapshot" :: held 5.155s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:34 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Created reservations ['441eab0c-85a3-4c53-84c8-19512c6874e0', '93cf8d6a-cba7-48cc-adc7-c7459817a8fa', '2f30b3db-2480-447c-98a6-88125b302df2', '9e733ad9-e407-4684-b805-96737c6cf224'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:31:34 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Delete snapshot completed successfully.
Apr 29 10:31:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f4dcc9d6-d749-46c8-9f6e-9918b7743234 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-fe5b1543-95c7-4308-acf6-0274df2d5b69-delete_snapshot" released by "delete_snapshot" :: held 5.323s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "cinder-ed7da93e-cfb1-4a5d-8677-5d07c425b66f-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:31:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-ed7da93e-cfb1-4a5d-8677-5d07c425b66f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:31:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "cinder-quobyte-ed7da93e-cfb1-4a5d-8677-5d07c425b66f" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:31:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-ed7da93e-cfb1-4a5d-8677-5d07c425b66f" acquired by "delete_volume" :: waited 0.028s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:31:34 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c8d5fc-b0c4-43d4-8ccb-ddd908cee377]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:34 devstack sudo[104789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f
Apr 29 10:31:34 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:36 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f" returned: 0 in 1.274s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:36 devstack sudo[104830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f
Apr 29 10:31:36 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:37 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ed7da93e-cfb1-4a5d-8677-5d07c425b66f" returned: 0 in 1.196s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:37 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-ed7da93e-cfb1-4a5d-8677-5d07c425b66f" released by "delete_volume" :: held 2.572s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:37 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Created reservations ['a34d2e06-06bf-4c06-8e2d-6fc1ef632904', 'afb2374c-1fb0-4911-951a-9414a064e31c', '13c359db-9726-4a8a-9e63-52922ffae55b', '440cb937-03e5-4a5b-8980-adbd28784cce'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:31:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:31:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:31:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:37 devstack sudo[104840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:31:37 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:38 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.327s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:38 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:31:38 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Deleted volume successfully.
Apr 29 10:31:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1c95962e-1125-4ca4-a094-7be77ba8fbb1 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-ed7da93e-cfb1-4a5d-8677-5d07c425b66f-delete_volume" released by "delete_volume" :: held 4.252s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Flow 'volume_create_manager' (f4b5aef1-3b45-4367-9328-d426cc08bcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c8ac4b-99e4-481f-abcb-2d31ebff9bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c8ac4b-99e4-481f-abcb-2d31ebff9bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-211850430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84547a78-735e-4d18-a677-2daa9821801a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd0e418810a4a65933223512479b8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:39Z,use_quota=True,user_id='fb2de558e9ca4968b6f34e041d51771f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7e63de-28c9-423c-aeb6-f496395d04d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7e63de-28c9-423c-aeb6-f496395d04d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3f53c9-1497-493f-a038-91d73a80ae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3f53c9-1497-493f-a038-91d73a80ae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84547a78-735e-4d18-a677-2daa9821801a', 'volume_name': 'volume-84547a78-735e-4d18-a677-2daa9821801a', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23b344e-80d0-43bf-b858-b138b0e9a4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23b344e-80d0-43bf-b858-b138b0e9a4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defff0ef-7b6c-4864-92c5-633cb7418eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:39 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Volume 84547a78-735e-4d18-a677-2daa9821801a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84547a78-735e-4d18-a677-2daa9821801a', 'volume_size': 1}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-211850430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84547a78-735e-4d18-a677-2daa9821801a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd0e418810a4a65933223512479b8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:39Z,use_quota=True,user_id='fb2de558e9ca4968b6f34e041d51771f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Creating volume 84547a78-735e-4d18-a677-2daa9821801a {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:31:39 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:39 devstack sudo[104879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a 1073741824
Apr 29 10:31:39 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:39 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-bc1f1541-ba55-4642-a1dd-420d1e46deea req-498ddc06-12ad-4706-b980-e648df8958f4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Terminate volume connection completed successfully.
Apr 29 10:31:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-bc1f1541-ba55-4642-a1dd-420d1e46deea req-498ddc06-12ad-4706-b980-e648df8958f4 tempest-TestInstancesWithCinderVolumes-1374990074 None] Deleting attachment f790ebf1-aae0-4649-a964-776b99d42b29. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:31:40 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a 1073741824" returned: 0 in 0.873s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:40 devstack sudo[104885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a
Apr 29 10:31:40 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:40 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a" returned: 0 in 0.626s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:40 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:31:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defff0ef-7b6c-4864-92c5-633cb7418eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84547a78-735e-4d18-a677-2daa9821801a', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220a3b78-d0f1-4192-a5f2-4b21aff08516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:40 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Volume volume-84547a78-735e-4d18-a677-2daa9821801a (84547a78-735e-4d18-a677-2daa9821801a): created successfully
Apr 29 10:31:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220a3b78-d0f1-4192-a5f2-4b21aff08516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Flow 'volume_create_manager' (f4b5aef1-3b45-4367-9328-d426cc08bcdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:31:40 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-02aaf1cf-efd7-4722-9042-7e06f502e28a tempest-VolumeDependencyTests-368492578 None] Created volume successfully.
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Flow 'volume_create_manager' (884ca042-ea2a-48ca-8a41-87d720a033e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c82d4e7-52c4-497b-8c8e-140c7d807959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c82d4e7-52c4-497b-8c8e-140c7d807959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1352612919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd0e418810a4a65933223512479b8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=84547a78-735e-4d18-a677-2daa9821801a,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:42Z,use_quota=True,user_id='fb2de558e9ca4968b6f34e041d51771f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab27b87-6624-45ac-bbfc-0daaeafe681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab27b87-6624-45ac-bbfc-0daaeafe681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9ab91f-0071-4855-8210-d2763c260e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9ab91f-0071-4855-8210-d2763c260e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e', 'volume_name': 'volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e', 'volume_size': 1, 'source_volid': '84547a78-735e-4d18-a677-2daa9821801a', 'source_volstatus': 'available'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304cb6cb-d338-4867-935c-6939f805ec2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304cb6cb-d338-4867-935c-6939f805ec2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7ddd42-4775-428a-a7ee-9106287c7931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:31:41 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Volume 7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e', 'volume_size': 1, 'source_volid': '84547a78-735e-4d18-a677-2daa9821801a', 'source_volstatus': 'available'}
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:41 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Cloning volume 84547a78-735e-4d18-a677-2daa9821801a to volume 7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Creating offline snapshot e0f0526f-d59c-4aab-af57-d76a9d2a5cb1 of volume 84547a78-735e-4d18-a677-2daa9821801a {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc94123f-2ceb-4ab4-a2b6-39f286c6d9a1]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:41 devstack sudo[104892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a
Apr 29 10:31:41 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:42 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a" returned: 0 in 0.720s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:42 devstack sudo[104898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1 1G
Apr 29 10:31:42 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "cinder-d3997ca0-aad2-4f58-be82-cc15509bb247-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:31:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "cinder-d3997ca0-aad2-4f58-be82-cc15509bb247-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:31:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "cinder-quobyte-d3997ca0-aad2-4f58-be82-cc15509bb247" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:31:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "cinder-quobyte-d3997ca0-aad2-4f58-be82-cc15509bb247" acquired by "delete_volume" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:31:43 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[968a13f9-993e-4b0b-9be7-9980d72a9c4d]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:43 devstack sudo[104903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247
Apr 29 10:31:43 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:43 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1 1G" returned: 0 in 0.979s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84547a78-735e-4d18-a677-2daa9821801a -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:43 devstack sudo[104951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84547a78-735e-4d18-a677-2daa9821801a -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1
Apr 29 10:31:43 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:44 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247" returned: 0 in 1.258s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:44 devstack sudo[104970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247
Apr 29 10:31:44 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:44 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84547a78-735e-4d18-a677-2daa9821801a -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1" returned: 0 in 1.123s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:44 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1 is being set with open permissions: ugo+rw
Apr 29 10:31:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:44 devstack sudo[104978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1
Apr 29 10:31:44 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:45 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247" returned: 1 in 0.866s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:31:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:45 devstack sudo[104984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247
Apr 29 10:31:45 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:45 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1" returned: 0 in 0.884s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:45 devstack sudo[104987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.info
Apr 29 10:31:45 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:46 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d3997ca0-aad2-4f58-be82-cc15509bb247" returned: 0 in 1.004s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "cinder-quobyte-d3997ca0-aad2-4f58-be82-cc15509bb247" released by "delete_volume" :: held 3.233s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:46 devstack cinder-volume[84165]: WARNING cinder.quota [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-383615213-472920596 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-383615213-472920596, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:31:46 devstack cinder-volume[84165]: WARNING cinder.quota [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-383615213-472920596 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-383615213-472920596, it is now deprecated. Please use the default quota class for default quota.
Apr 29 10:31:46 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Created reservations ['d111a8e4-f329-4f03-92d4-e361d87cf970', '3ecbe679-57eb-4b38-b699-79e39e689196', 'ea2b48c2-3e72-44eb-9a9f-9932ba0aea6f', 'e1cc5dd9-db97-4a35-bf5b-9f3bdebcc730'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:31:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:31:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:31:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:46 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.info" returned: 0 in 0.955s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:46 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.info is being set with open permissions: ugo+rw
Apr 29 10:31:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:46 devstack sudo[104991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:31:46 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:46 devstack sudo[104992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.info
Apr 29 10:31:46 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:47 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.info" returned: 0 in 0.882s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:47 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "cinder-quobyte-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e" by "_copy_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:31:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.948s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:47 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:31:47 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Deleted volume successfully.
Apr 29 10:31:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:31:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] snapshot: e0f0526f-d59c-4aab-af57-d76a9d2a5cb1, volume: 7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e,  {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 10:31:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:31:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:31:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:31:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:31:47 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44023c7-2e07-4951-8fea-ce35e5901682]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7c4b74ce-adfa-42b3-b014-186d6891f2a1 tempest-TestInstancesWithCinderVolumes-1374990074 None] Lock "cinder-d3997ca0-aad2-4f58-be82-cc15509bb247-delete_volume" released by "delete_volume" :: held 4.608s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:47 devstack sudo[104997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1
Apr 29 10:31:47 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:48 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1" returned: 0 in 1.147s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84547a78-735e-4d18-a677-2daa9821801a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:31:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 10:31:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Creating direct copy from snapshot {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 10:31:48 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c92db14-d897-4312-990a-f0015b0d6b91]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:48 devstack sudo[105003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a
Apr 29 10:31:48 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:49 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a" returned: 0 in 0.854s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:49 devstack cinder-volume[84165]: DEBUG cinder.utils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Path /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e not found in is_blk_device check {{(pid=84165) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 10:31:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:49 devstack sudo[105009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e
Apr 29 10:31:49 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:56 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=44,cinder:UPDATE=50,cinder:INSERT=14,cinder:DELETE=7 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:31:57 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e" returned: 0 in 7.387s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:57 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[64985cf6-0487-4c92-bc1d-e7ae57b5fb78]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:57 devstack sudo[105027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a
Apr 29 10:31:57 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:57 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=48,cinder:UPDATE=48,cinder:INSERT=11,cinder:DELETE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:31:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-d7affb5b-b2d7-48f6-9e87-a2027d0e0fe8 req-a66793ab-3b37-480a-8382-22c0e700f45c tempest-TestServerVolumeAttachmentScenario-1170700729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:31:58 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a" returned: 0 in 1.097s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:58 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:31:58 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Converted 1024.00 MB image at 138.59 MB/s
Apr 29 10:31:58 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e is being set with open permissions: ugo+rw
Apr 29 10:31:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:58 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e
Apr 29 10:31:58 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:58 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e" returned: 0 in 0.682s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e" released by "_copy_volume_from_snapshot" :: held 11.344s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:31:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "cinder-quobyte-e0f0526f-d59c-4aab-af57-d76a9d2a5cb1" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:31:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-e0f0526f-d59c-4aab-af57-d76a9d2a5cb1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:31:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Deleting offline snapshot e0f0526f-d59c-4aab-af57-d76a9d2a5cb1 of volume 84547a78-735e-4d18-a677-2daa9821801a {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:31:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] snapshot_file for this snap is: volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:31:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3870106-d671-4ba4-ac40-baec913d14f8]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:59 devstack sudo[105063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1
Apr 29 10:31:59 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:31:59 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root
Apr 29 10:31:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1" returned: 0 in 0.755s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:31:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84547a78-735e-4d18-a677-2daa9821801a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:31:59 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6715cf-c79a-4b20-a186-f1afdde132ad]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:31:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:31:59 devstack sudo[105068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a
Apr 29 10:31:59 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:00 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a" returned: 0 in 0.821s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:00 devstack sudo[105074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1
Apr 29 10:32:00 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:01 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1" returned: 0 in 0.731s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:01 devstack sudo[105080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1
Apr 29 10:32:01 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:01 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a.e0f0526f-d59c-4aab-af57-d76a9d2a5cb1" returned: 0 in 0.630s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-e0f0526f-d59c-4aab-af57-d76a9d2a5cb1" released by "_delete_snapshot" :: held 3.048s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.215s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-d7affb5b-b2d7-48f6-9e87-a2027d0e0fe8 req-a66793ab-3b37-480a-8382-22c0e700f45c tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.070s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7ddd42-4775-428a-a7ee-9106287c7931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e', 'volume_size': 1, 'source_volid': '84547a78-735e-4d18-a677-2daa9821801a', 'source_volstatus': 'available'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1d1f0d-9048-4c6b-bc71-a1efe0e4f47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:02 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e38cbcd-f6e5-4d30-9302-162c795e839b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:32:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-d7affb5b-b2d7-48f6-9e87-a2027d0e0fe8 req-a66793ab-3b37-480a-8382-22c0e700f45c tempest-TestServerVolumeAttachmentScenario-1170700729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c987ba6-f88d-4863-bec4-8e07f8013817 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:02 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Volume volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e (7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e): created successfully
Apr 29 10:32:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1d1f0d-9048-4c6b-bc71-a1efe0e4f47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Flow 'volume_create_manager' (884ca042-ea2a-48ca-8a41-87d720a033e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:32:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-9ebbdecd-baa8-4618-850e-4c2fdbbaa6e5 tempest-VolumeDependencyTests-368492578 None] Created volume successfully.
Apr 29 10:32:02 devstack sudo[105085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c987ba6-f88d-4863-bec4-8e07f8013817
Apr 29 10:32:02 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:02 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-d7affb5b-b2d7-48f6-9e87-a2027d0e0fe8 req-a66793ab-3b37-480a-8382-22c0e700f45c tempest-TestServerVolumeAttachmentScenario-1170700729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c987ba6-f88d-4863-bec4-8e07f8013817" returned: 0 in 0.804s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-d7affb5b-b2d7-48f6-9e87-a2027d0e0fe8 req-a66793ab-3b37-480a-8382-22c0e700f45c tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.844s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-d7affb5b-b2d7-48f6-9e87-a2027d0e0fe8 req-a66793ab-3b37-480a-8382-22c0e700f45c tempest-TestServerVolumeAttachmentScenario-1170700729 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-3c987ba6-f88d-4863-bec4-8e07f8013817', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e8f676f-98e1-494c-b54f-9b55ab019bf7', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:32:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-d7affb5b-b2d7-48f6-9e87-a2027d0e0fe8 req-a66793ab-3b37-480a-8382-22c0e700f45c tempest-TestServerVolumeAttachmentScenario-1170700729 None] attachment_update completed successfully.
Apr 29 10:32:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "cinder-84547a78-735e-4d18-a677-2daa9821801a-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-84547a78-735e-4d18-a677-2daa9821801a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "cinder-quobyte-84547a78-735e-4d18-a677-2daa9821801a" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-84547a78-735e-4d18-a677-2daa9821801a" acquired by "delete_volume" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:03 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7821e10b-8423-4161-aa14-bd9c66905a27]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:32:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:03 devstack sudo[105090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a
Apr 29 10:32:03 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:03 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a" returned: 0 in 0.845s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:04 devstack sudo[105163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a
Apr 29 10:32:04 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:04 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84547a78-735e-4d18-a677-2daa9821801a" returned: 0 in 0.752s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-84547a78-735e-4d18-a677-2daa9821801a" released by "delete_volume" :: held 1.666s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:04 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Created reservations ['a8d80941-8368-4a4e-82d3-2c2feb391786', '08c754c8-3f71-4b69-943e-d9265a9ae1cc', '6ee88b20-a0ce-4733-9f27-861e53d70558', '1ca43a0d-d8d4-4994-a9bd-2d634a01a9f3'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:32:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:32:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:32:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:05 devstack sudo[105482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:32:05 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "cinder-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "cinder-quobyte-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e" acquired by "delete_volume" :: waited 0.030s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:32:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:32:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:32:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:05 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ee4e42-27a3-4f06-8505-7e04548689af]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:32:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:05 devstack sudo[105484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:32:05 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:05 devstack sudo[105485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e
Apr 29 10:32:05 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:06 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.142s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:32:06 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Deleted volume successfully.
Apr 29 10:32:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9bf043b7-4178-4a54-a1de-5d77002a5ce0 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-84547a78-735e-4d18-a677-2daa9821801a-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:06 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.848s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:32:06 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e" returned: 0 in 1.183s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:06 devstack sudo[105493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e
Apr 29 10:32:06 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:07 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e" returned: 0 in 0.691s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:07 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e" released by "delete_volume" :: held 1.976s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:07 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Created reservations ['cda19143-58af-4f7f-99ce-27f2f8cdab31', 'd1da2581-52e2-4059-bd24-38217f7dbf8e', '7e9729de-236c-40ad-bddd-790773c72f9b', '0a4b7cc2-e5d0-4bd8-bf41-200fe9aa1928'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:32:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:32:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:32:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:07 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:32:07 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:07 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Acquiring lock "cinder-067a5fdc-9ec7-4be3-8949-aaa695c28f45-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:07 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Lock "cinder-067a5fdc-9ec7-4be3-8949-aaa695c28f45-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:07 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Acquiring lock "cinder-quobyte-067a5fdc-9ec7-4be3-8949-aaa695c28f45" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:07 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-067a5fdc-9ec7-4be3-8949-aaa695c28f45" acquired by "delete_volume" :: waited 0.028s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:07 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fecb61-ff32-41ef-8825-380e45d9d941]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:32:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:08 devstack sudo[105499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45
Apr 29 10:32:08 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:08 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.957s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:08 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:32:08 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Deleted volume successfully.
Apr 29 10:32:08 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a3e64ff3-aa23-4637-8ac8-265ca1d63dc9 tempest-VolumeDependencyTests-368492578 None] Lock "cinder-7c673d3d-e7e4-4f0a-bd99-813d4a7ca79e-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:09 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45" returned: 0 in 1.235s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:09 devstack sudo[105507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45
Apr 29 10:32:09 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Flow 'volume_create_manager' (4e7b5912-fc43-401c-abe7-c90796af79dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92827cd8-e7fb-4839-8004-bea1f6d95734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92827cd8-e7fb-4839-8004-bea1f6d95734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-396955473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2803b2a8-3870-477c-bf0b-0f7da86bfd23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652299132e054fc28310cdda8623b251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:09Z,use_quota=True,user_id='a5805bf0486c4222a2595c942f814a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e26508-9968-476f-8289-63008605628e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e26508-9968-476f-8289-63008605628e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ce1683-8f2e-453b-bbb2-ad7dcf2cc93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ce1683-8f2e-453b-bbb2-ad7dcf2cc93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2803b2a8-3870-477c-bf0b-0f7da86bfd23', 'volume_name': 'volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cb40c7-07ef-4fba-9dec-de685dc51d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cb40c7-07ef-4fba-9dec-de685dc51d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60f342c-2f2b-4352-b8b5-004f3458702e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:09 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Volume 2803b2a8-3870-477c-bf0b-0f7da86bfd23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23', 'volume_size': 1}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-396955473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2803b2a8-3870-477c-bf0b-0f7da86bfd23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652299132e054fc28310cdda8623b251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:09Z,use_quota=True,user_id='a5805bf0486c4222a2595c942f814a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Creating volume 2803b2a8-3870-477c-bf0b-0f7da86bfd23 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:32:09 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:09 devstack sudo[105509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23 1073741824
Apr 29 10:32:09 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:09 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-067a5fdc-9ec7-4be3-8949-aaa695c28f45" returned: 0 in 0.807s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Lock "cinder-quobyte-067a5fdc-9ec7-4be3-8949-aaa695c28f45" released by "delete_volume" :: held 2.110s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:10 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Created reservations ['ce767f5b-7435-41e0-9161-ad3fdad4d7d6', 'd912fe21-4640-4bb4-84eb-b0f0bef2f00e', 'b3b3e4ca-3df6-4289-9306-401698b54630', 'a76cbec3-70b5-4043-9af7-d22b7881dcc1'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:32:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:32:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:32:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:10 devstack sudo[105514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:32:10 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:10 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23 1073741824" returned: 0 in 1.419s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:11 devstack sudo[105518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23
Apr 29 10:32:11 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:11 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.072s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:11 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:32:11 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Deleted volume successfully.
Apr 29 10:32:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f40febc9-ba36-470f-99ab-894a776391ee tempest-VolumeDependencyTests-368492578 None] Lock "cinder-067a5fdc-9ec7-4be3-8949-aaa695c28f45-delete_volume" released by "delete_volume" :: held 3.548s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:11 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23" returned: 0 in 0.917s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] <== create_volume: return (2417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:32:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.420s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60f342c-2f2b-4352-b8b5-004f3458702e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16beb663-e274-498e-b02f-af78e55e278a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:12 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Volume volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23 (2803b2a8-3870-477c-bf0b-0f7da86bfd23): created successfully
Apr 29 10:32:12 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16beb663-e274-498e-b02f-af78e55e278a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:12 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Flow 'volume_create_manager' (4e7b5912-fc43-401c-abe7-c90796af79dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:32:12 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-41ea6822-d36d-4650-a2b0-e6f69bc12f9f tempest-AttachVolumeNegativeTest-1686417134 None] Created volume successfully.
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Flow 'volume_create_manager' (ff7cbf8c-8ece-40aa-9d2e-4bfb03fd8cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34275146-e00c-4a21-849b-c47a02b04646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34275146-e00c-4a21-849b-c47a02b04646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a06336-6f5c-4ed2-abd6-744e61363836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e340eab9dfe145ceb9ad35b723386546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:15Z,use_quota=True,user_id='855f67cd737e4ed58473a324a0adb498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a975b29e-8dda-400c-9a69-6015d4816e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a975b29e-8dda-400c-9a69-6015d4816e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7718a73-3fac-4858-8aa3-75c7550f8cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7718a73-3fac-4858-8aa3-75c7550f8cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a06336-6f5c-4ed2-abd6-744e61363836', 'volume_name': 'volume-48a06336-6f5c-4ed2-abd6-744e61363836', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20167754-4445-43f6-9e03-4f75c43f2d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20167754-4445-43f6-9e03-4f75c43f2d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22f627f-abd1-46e4-98cc-dbfe6a2d773c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:14 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Volume 48a06336-6f5c-4ed2-abd6-744e61363836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a06336-6f5c-4ed2-abd6-744e61363836', 'volume_size': 1}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a06336-6f5c-4ed2-abd6-744e61363836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e340eab9dfe145ceb9ad35b723386546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:15Z,use_quota=True,user_id='855f67cd737e4ed58473a324a0adb498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Creating volume 48a06336-6f5c-4ed2-abd6-744e61363836 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:32:14 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:32:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-48a06336-6f5c-4ed2-abd6-744e61363836 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:14 devstack sudo[105523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-48a06336-6f5c-4ed2-abd6-744e61363836 1073741824
Apr 29 10:32:14 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:15 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-48a06336-6f5c-4ed2-abd6-744e61363836 1073741824" returned: 0 in 1.040s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-48a06336-6f5c-4ed2-abd6-744e61363836 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:15 devstack sudo[105528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-48a06336-6f5c-4ed2-abd6-744e61363836
Apr 29 10:32:15 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-fa13e499-fd86-4aab-a1fa-6dd99b8e911c req-1225ac21-1b6a-4529-85ff-cca3c18106ea tempest-TestServerVolumeAttachmentScenario-1170700729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-b7dda12f-6766-4abc-bd30-de99e0cfdf93 req-a2ffc276-b473-4e32-b3a7-04e5f08cf04f tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:16 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-48a06336-6f5c-4ed2-abd6-744e61363836" returned: 0 in 0.919s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:32:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-fa13e499-fd86-4aab-a1fa-6dd99b8e911c req-1225ac21-1b6a-4529-85ff-cca3c18106ea tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.196s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22f627f-abd1-46e4-98cc-dbfe6a2d773c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a06336-6f5c-4ed2-abd6-744e61363836', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d01179-7d56-4510-94a4-7688baf1f8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:16 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53fd172-33c8-4d62-a81c-317ef00e37cf]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:32:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-fa13e499-fd86-4aab-a1fa-6dd99b8e911c req-1225ac21-1b6a-4529-85ff-cca3c18106ea tempest-TestServerVolumeAttachmentScenario-1170700729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:16 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Volume volume-48a06336-6f5c-4ed2-abd6-744e61363836 (48a06336-6f5c-4ed2-abd6-744e61363836): created successfully
Apr 29 10:32:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d01179-7d56-4510-94a4-7688baf1f8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Flow 'volume_create_manager' (ff7cbf8c-8ece-40aa-9d2e-4bfb03fd8cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:32:16 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-4a6584ff-18e2-44e9-8f2d-de125761985f tempest-CinderUnicodeTest-1248473945 None] Created volume successfully.
Apr 29 10:32:16 devstack sudo[105550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2
Apr 29 10:32:16 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:17 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-fa13e499-fd86-4aab-a1fa-6dd99b8e911c req-1225ac21-1b6a-4529-85ff-cca3c18106ea tempest-TestServerVolumeAttachmentScenario-1170700729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2" returned: 0 in 0.839s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-fa13e499-fd86-4aab-a1fa-6dd99b8e911c req-1225ac21-1b6a-4529-85ff-cca3c18106ea tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.876s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-b7dda12f-6766-4abc-bd30-de99e0cfdf93 req-a2ffc276-b473-4e32-b3a7-04e5f08cf04f tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.030s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:17 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec63f442-5ecf-4220-9883-dc706e9d7e8b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:32:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-b7dda12f-6766-4abc-bd30-de99e0cfdf93 req-a2ffc276-b473-4e32-b3a7-04e5f08cf04f tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:17 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-fa13e499-fd86-4aab-a1fa-6dd99b8e911c req-1225ac21-1b6a-4529-85ff-cca3c18106ea tempest-TestServerVolumeAttachmentScenario-1170700729 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51ba68c1-191c-4c7a-bce1-948a144f3181', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:32:17 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-fa13e499-fd86-4aab-a1fa-6dd99b8e911c req-1225ac21-1b6a-4529-85ff-cca3c18106ea tempest-TestServerVolumeAttachmentScenario-1170700729 None] attachment_update completed successfully.
Apr 29 10:32:17 devstack sudo[105555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23
Apr 29 10:32:17 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:18 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-b7dda12f-6766-4abc-bd30-de99e0cfdf93 req-a2ffc276-b473-4e32-b3a7-04e5f08cf04f tempest-AttachVolumeNegativeTest-1686417134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23" returned: 0 in 0.860s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-b7dda12f-6766-4abc-bd30-de99e0cfdf93 req-a2ffc276-b473-4e32-b3a7-04e5f08cf04f tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.885s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-b7dda12f-6766-4abc-bd30-de99e0cfdf93 req-a2ffc276-b473-4e32-b3a7-04e5f08cf04f tempest-AttachVolumeNegativeTest-1686417134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '316393ad-2d3c-4d1b-ab28-9e088075e183', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:32:18 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-b7dda12f-6766-4abc-bd30-de99e0cfdf93 req-a2ffc276-b473-4e32-b3a7-04e5f08cf04f tempest-AttachVolumeNegativeTest-1686417134 None] attachment_update completed successfully.
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Flow 'volume_create_manager' (0159c218-77d3-453e-a76c-1104fd45dfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc21245-c445-4554-a2b1-f3c7a4309b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc21245-c445-4554-a2b1-f3c7a4309b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:32:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-612577759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456344b4-1543-43e8-8113-8c49a95b230f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e340eab9dfe145ceb9ad35b723386546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:19Z,use_quota=True,user_id='855f67cd737e4ed58473a324a0adb498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887bc252-ef69-4ab5-8df2-12238280c2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887bc252-ef69-4ab5-8df2-12238280c2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f7773f-83f7-48ad-a946-88e2aadd8722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f7773f-83f7-48ad-a946-88e2aadd8722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456344b4-1543-43e8-8113-8c49a95b230f', 'volume_name': 'volume-456344b4-1543-43e8-8113-8c49a95b230f', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23abe88-678e-47e1-9551-18a7e40d0ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23abe88-678e-47e1-9551-18a7e40d0ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55674a58-912f-4712-b58c-66b9ecbca245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:18 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Volume 456344b4-1543-43e8-8113-8c49a95b230f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456344b4-1543-43e8-8113-8c49a95b230f', 'volume_size': 1}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:32:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-612577759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456344b4-1543-43e8-8113-8c49a95b230f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e340eab9dfe145ceb9ad35b723386546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:19Z,use_quota=True,user_id='855f67cd737e4ed58473a324a0adb498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Creating volume 456344b4-1543-43e8-8113-8c49a95b230f {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:32:18 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:32:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:18 devstack sudo[105562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f 1073741824
Apr 29 10:32:18 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:19 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f 1073741824" returned: 0 in 0.974s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:19 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f
Apr 29 10:32:19 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:20 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f" returned: 0 in 0.671s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:32:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55674a58-912f-4712-b58c-66b9ecbca245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456344b4-1543-43e8-8113-8c49a95b230f', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490015a5-0255-43b3-afcd-e25d4cf46e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:20 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Volume volume-456344b4-1543-43e8-8113-8c49a95b230f (456344b4-1543-43e8-8113-8c49a95b230f): created successfully
Apr 29 10:32:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490015a5-0255-43b3-afcd-e25d4cf46e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Flow 'volume_create_manager' (0159c218-77d3-453e-a76c-1104fd45dfb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:32:20 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-66db8908-098a-4381-82f2-002a29be054d tempest-CinderUnicodeTest-1248473945 None] Created volume successfully.
Apr 29 10:32:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] Creating offline snapshot 47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e of volume 456344b4-1543-43e8-8113-8c49a95b230f {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:32:21 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb93b14-a6b8-4d3a-b366-88c628eee1bb]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:32:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:21 devstack sudo[105573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f
Apr 29 10:32:21 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:22 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f" returned: 0 in 0.824s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:22 devstack sudo[105585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e 1G
Apr 29 10:32:22 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:23 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e 1G" returned: 0 in 1.142s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456344b4-1543-43e8-8113-8c49a95b230f -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:23 devstack sudo[105627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456344b4-1543-43e8-8113-8c49a95b230f -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e
Apr 29 10:32:23 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:24 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456344b4-1543-43e8-8113-8c49a95b230f -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e" returned: 0 in 0.765s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:24 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e is being set with open permissions: ugo+rw
Apr 29 10:32:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:24 devstack sudo[105659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e
Apr 29 10:32:24 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:24 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-2e56ca7f-6e29-4c77-8e47-29b887ca9f4b req-2efbc4b8-4c96-4a90-9069-5eacc9dd261b tempest-TestServerVolumeAttachmentScenario-1170700729 None] Terminate volume connection completed successfully.
Apr 29 10:32:24 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-2e56ca7f-6e29-4c77-8e47-29b887ca9f4b req-2efbc4b8-4c96-4a90-9069-5eacc9dd261b tempest-TestServerVolumeAttachmentScenario-1170700729 None] Deleting attachment 51ba68c1-191c-4c7a-bce1-948a144f3181. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:32:24 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e" returned: 0 in 0.842s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:25 devstack sudo[105665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.info
Apr 29 10:32:25 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:25 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.info" returned: 0 in 0.948s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:25 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.info is being set with open permissions: ugo+rw
Apr 29 10:32:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:25 devstack sudo[105683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.info
Apr 29 10:32:25 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:26 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.info" returned: 0 in 0.817s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.563s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:26 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-6902c626-139d-4b63-838b-f5854ca61627 tempest-CinderUnicodeTest-1248473945 None] Create snapshot completed successfully
Apr 29 10:32:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Acquiring lock "cinder-47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Lock "cinder-47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Acquiring lock "cinder-quobyte-456344b4-1543-43e8-8113-8c49a95b230f" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Lock "cinder-quobyte-456344b4-1543-43e8-8113-8c49a95b230f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Acquiring lock "cinder-quobyte-47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Lock "cinder-quobyte-47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Deleting offline snapshot 47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e of volume 456344b4-1543-43e8-8113-8c49a95b230f {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:32:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] snapshot_file for this snap is: volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:32:27 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2855ad57-cb34-4fe2-b009-a1f3f7bf4396]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:32:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:28 devstack sudo[105691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e
Apr 29 10:32:28 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:28 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-9056d9de-abd4-415c-a61b-8c83bf8b97de req-70f71b6d-f889-43e9-b20a-f75a5565b418 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Terminate volume connection completed successfully.
Apr 29 10:32:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-9056d9de-abd4-415c-a61b-8c83bf8b97de req-70f71b6d-f889-43e9-b20a-f75a5565b418 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Deleting attachment 2e8f676f-98e1-494c-b54f-9b55ab019bf7. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:32:29 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e" returned: 0 in 1.232s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-456344b4-1543-43e8-8113-8c49a95b230f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:32:29 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed62cd6a-a1f1-41d5-8dbf-30e101f0defb]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:32:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:29 devstack sudo[105698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f
Apr 29 10:32:29 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:29 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f" returned: 0 in 0.816s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:30 devstack sudo[105703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e
Apr 29 10:32:30 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:30 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e" returned: 0 in 0.829s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:30 devstack sudo[105708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e
Apr 29 10:32:30 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:31 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f.47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e" returned: 0 in 0.708s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Lock "cinder-quobyte-47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e" released by "_delete_snapshot" :: held 3.732s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Lock "cinder-quobyte-456344b4-1543-43e8-8113-8c49a95b230f" released by "delete_snapshot" :: held 3.777s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:31 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Created reservations ['7017936a-8eb8-48de-beb0-60ba5add77c7', '5c9d385b-3181-474b-8f24-d11894c882ca', 'bcc33ade-10fb-4bed-a348-20a0522b1e6b', '8307d33c-af3e-4dff-8ef7-ef240678651e'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:32:31 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Delete snapshot completed successfully.
Apr 29 10:32:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-13e88749-36fd-4cf0-8b7b-c11e7bb0854c tempest-CinderUnicodeTest-1248473945 None] Lock "cinder-47b3b1dd-ab4a-4eae-87d5-9c0dd2f0d05e-delete_snapshot" released by "delete_snapshot" :: held 3.981s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Acquiring lock "cinder-456344b4-1543-43e8-8113-8c49a95b230f-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Lock "cinder-456344b4-1543-43e8-8113-8c49a95b230f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Acquiring lock "cinder-quobyte-456344b4-1543-43e8-8113-8c49a95b230f" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Lock "cinder-quobyte-456344b4-1543-43e8-8113-8c49a95b230f" acquired by "delete_volume" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:32 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe48b6c-c8da-4cd1-a00f-8ae4c0e048b0]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:32:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:32 devstack sudo[105747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f
Apr 29 10:32:32 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:33 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f" returned: 0 in 0.770s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:33 devstack sudo[105752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f
Apr 29 10:32:33 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:33 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-456344b4-1543-43e8-8113-8c49a95b230f" returned: 0 in 0.784s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Lock "cinder-quobyte-456344b4-1543-43e8-8113-8c49a95b230f" released by "delete_volume" :: held 1.658s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:33 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Created reservations ['fdd87e58-ca69-4879-9fe9-ad6e9cbe813b', '875571c6-c161-41a5-bbad-41155861e260', '07a72ee1-4f4e-4622-ba05-af655c68595f', 'c3cd2df5-0c5c-431c-9fc0-c0dade171672'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:32:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:32:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:32:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:34 devstack sudo[105758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:32:34 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Acquiring lock "cinder-48a06336-6f5c-4ed2-abd6-744e61363836-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Lock "cinder-48a06336-6f5c-4ed2-abd6-744e61363836-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Acquiring lock "cinder-quobyte-48a06336-6f5c-4ed2-abd6-744e61363836" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Lock "cinder-quobyte-48a06336-6f5c-4ed2-abd6-744e61363836" acquired by "delete_volume" :: waited 0.030s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:34 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2cd5d5-7db8-4beb-9d9a-5e50624a8b30]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:32:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-48a06336-6f5c-4ed2-abd6-744e61363836 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:34 devstack sudo[105761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-48a06336-6f5c-4ed2-abd6-744e61363836
Apr 29 10:32:34 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:35 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.146s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:35 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:32:35 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Deleted volume successfully.
Apr 29 10:32:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0a28eb86-1133-4726-bfe5-2c2ee3df006f tempest-CinderUnicodeTest-1248473945 None] Lock "cinder-456344b4-1543-43e8-8113-8c49a95b230f-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:35 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-48a06336-6f5c-4ed2-abd6-744e61363836" returned: 0 in 0.997s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-48a06336-6f5c-4ed2-abd6-744e61363836 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:35 devstack sudo[105778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-48a06336-6f5c-4ed2-abd6-744e61363836
Apr 29 10:32:35 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:36 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-48a06336-6f5c-4ed2-abd6-744e61363836" returned: 0 in 0.655s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:36 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Lock "cinder-quobyte-48a06336-6f5c-4ed2-abd6-744e61363836" released by "delete_volume" :: held 1.715s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:36 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Created reservations ['2e564529-2f56-4e57-992d-5c1c9948c48b', '251d0817-d1cd-48cf-88d4-ad352dbdd16d', '428ff780-b70b-487e-ab9b-30b1fd642645', 'ffc6349b-8815-479f-8201-f8667505dbd0'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:32:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:32:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:32:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:36 devstack sudo[105787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:32:36 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:37 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.688s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:37 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:32:37 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Deleted volume successfully.
Apr 29 10:32:37 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-96fad957-f325-4ee3-8998-598cc6e53f5f tempest-CinderUnicodeTest-1248473945 None] Lock "cinder-48a06336-6f5c-4ed2-abd6-744e61363836-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Acquiring lock "cinder-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "cinder-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Acquiring lock "cinder-quobyte-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "cinder-quobyte-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:41 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c8475f-63ea-4560-99d1-d170f400cedf]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:32:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:41 devstack sudo[105848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2
Apr 29 10:32:41 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:42 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2" returned: 0 in 0.960s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:42 devstack sudo[105869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2
Apr 29 10:32:42 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:43 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2" returned: 0 in 0.781s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "cinder-quobyte-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2" released by "delete_volume" :: held 1.817s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:43 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Created reservations ['aa0034de-5705-47ff-8aac-92799d3b1465', '0e028a4a-7433-4f9e-88bc-5dfa7cb023ad', 'fc2930c2-4111-4c28-a25d-cbaf3d3bd972', '217261de-065d-4b9f-922e-a0a061cf10f7'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:32:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:32:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:32:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:43 devstack sudo[105873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:32:43 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Acquiring lock "cinder-3c987ba6-f88d-4863-bec4-8e07f8013817-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "cinder-3c987ba6-f88d-4863-bec4-8e07f8013817-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Acquiring lock "cinder-quobyte-3c987ba6-f88d-4863-bec4-8e07f8013817" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:32:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "cinder-quobyte-3c987ba6-f88d-4863-bec4-8e07f8013817" acquired by "delete_volume" :: waited 0.024s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:32:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0f0ce1-11c5-4f4a-be4b-e5d98c1b6c89]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:32:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c987ba6-f88d-4863-bec4-8e07f8013817 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:44 devstack sudo[105875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c987ba6-f88d-4863-bec4-8e07f8013817
Apr 29 10:32:44 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:44 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.870s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:44 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:32:44 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Deleted volume successfully.
Apr 29 10:32:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3a61fa3e-8463-4713-801f-146d808c317d tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "cinder-5fb5e6de-bc4d-42f9-85b4-a63e02cd35f2-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:45 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c987ba6-f88d-4863-bec4-8e07f8013817" returned: 0 in 1.050s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c987ba6-f88d-4863-bec4-8e07f8013817 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:45 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c987ba6-f88d-4863-bec4-8e07f8013817
Apr 29 10:32:45 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:45 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c987ba6-f88d-4863-bec4-8e07f8013817" returned: 0 in 0.693s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "cinder-quobyte-3c987ba6-f88d-4863-bec4-8e07f8013817" released by "delete_volume" :: held 1.807s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:45 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Created reservations ['b6d9db68-21c7-4880-9d2e-3e9dbf178e73', '00764dec-253d-4709-9d58-45e9b0ecde1c', '645b22f5-8a22-49a3-b8e4-2e8d10ca4fb0', 'de044811-6d6c-46a2-8a84-350927e5881a'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:32:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:32:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:32:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:46 devstack sudo[105889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:32:46 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:47 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.145s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:47 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:32:47 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Deleted volume successfully.
Apr 29 10:32:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2cb3e6f3-06b5-4a23-9968-5b1e467465e8 tempest-TestServerVolumeAttachmentScenario-1170700729 None] Lock "cinder-3c987ba6-f88d-4863-bec4-8e07f8013817-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Flow 'volume_create_manager' (101c6566-7340-4aac-bb77-b823d25fc08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89546c63-6d6e-41ff-bdff-0b6ca542d966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89546c63-6d6e-41ff-bdff-0b6ca542d966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1545068126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f7083d-0b4f-466f-919f-1217e17c0d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa30a0d27d6461fa96eaa85fedf0e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:52Z,use_quota=True,user_id='f1d7bede615e4022813ccdb39036aeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7138348-c7cd-4433-b7ae-da1bfc698af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7138348-c7cd-4433-b7ae-da1bfc698af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03ee439-2fcb-4c07-a90d-d0528c6a7586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03ee439-2fcb-4c07-a90d-d0528c6a7586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f7083d-0b4f-466f-919f-1217e17c0d26', 'volume_name': 'volume-35f7083d-0b4f-466f-919f-1217e17c0d26', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa584d5-9941-4d42-a124-0ea6f1773b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa584d5-9941-4d42-a124-0ea6f1773b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82949e92-6980-463c-995e-7339d360752e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:52 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Volume 35f7083d-0b4f-466f-919f-1217e17c0d26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f7083d-0b4f-466f-919f-1217e17c0d26', 'volume_size': 1}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1545068126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f7083d-0b4f-466f-919f-1217e17c0d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa30a0d27d6461fa96eaa85fedf0e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:52Z,use_quota=True,user_id='f1d7bede615e4022813ccdb39036aeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Creating volume 35f7083d-0b4f-466f-919f-1217e17c0d26 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:32:52 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:32:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-35f7083d-0b4f-466f-919f-1217e17c0d26 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:52 devstack sudo[105961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-35f7083d-0b4f-466f-919f-1217e17c0d26 1073741824
Apr 29 10:32:52 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:53 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-35f7083d-0b4f-466f-919f-1217e17c0d26 1073741824" returned: 0 in 1.132s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-35f7083d-0b4f-466f-919f-1217e17c0d26 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:53 devstack sudo[105967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-35f7083d-0b4f-466f-919f-1217e17c0d26
Apr 29 10:32:53 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:54 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-35f7083d-0b4f-466f-919f-1217e17c0d26" returned: 0 in 0.960s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:32:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:54 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82949e92-6980-463c-995e-7339d360752e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f7083d-0b4f-466f-919f-1217e17c0d26', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:54 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76989b9c-7de0-421c-abfb-bf2a98d69785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:32:54 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Volume volume-35f7083d-0b4f-466f-919f-1217e17c0d26 (35f7083d-0b4f-466f-919f-1217e17c0d26): created successfully
Apr 29 10:32:54 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76989b9c-7de0-421c-abfb-bf2a98d69785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:32:54 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Flow 'volume_create_manager' (101c6566-7340-4aac-bb77-b823d25fc08f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:32:54 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-429597c5-eb2b-4737-881b-0fce55e791f8 tempest-TestMinimumBasicScenario-248248190 None] Created volume successfully.
Apr 29 10:32:58 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=73,cinder:UPDATE=86,cinder:INSERT=23,cinder:DELETE=6 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:32:58 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=80,cinder:SELECT=72,cinder:INSERT=15,cinder:DELETE=7 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:32:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-51f2696e-a4bd-4bb5-827f-7de4fe93d261 req-ab290609-3d3e-411c-b362-ca5e18443f58 tempest-TestMinimumBasicScenario-248248190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:32:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-51f2696e-a4bd-4bb5-827f-7de4fe93d261 req-ab290609-3d3e-411c-b362-ca5e18443f58 tempest-TestMinimumBasicScenario-248248190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:32:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0636a8-9c24-44e6-9084-56a1f382ddc2]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:32:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-51f2696e-a4bd-4bb5-827f-7de4fe93d261 req-ab290609-3d3e-411c-b362-ca5e18443f58 tempest-TestMinimumBasicScenario-248248190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-35f7083d-0b4f-466f-919f-1217e17c0d26 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:32:58 devstack sudo[105998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-35f7083d-0b4f-466f-919f-1217e17c0d26
Apr 29 10:32:58 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:32:59 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root
Apr 29 10:32:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-51f2696e-a4bd-4bb5-827f-7de4fe93d261 req-ab290609-3d3e-411c-b362-ca5e18443f58 tempest-TestMinimumBasicScenario-248248190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-35f7083d-0b4f-466f-919f-1217e17c0d26" returned: 0 in 0.882s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:32:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-51f2696e-a4bd-4bb5-827f-7de4fe93d261 req-ab290609-3d3e-411c-b362-ca5e18443f58 tempest-TestMinimumBasicScenario-248248190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.913s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:32:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-51f2696e-a4bd-4bb5-827f-7de4fe93d261 req-ab290609-3d3e-411c-b362-ca5e18443f58 tempest-TestMinimumBasicScenario-248248190 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-35f7083d-0b4f-466f-919f-1217e17c0d26', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1aea1279-9069-4a41-a6f5-d717122a6aeb', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:32:59 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-51f2696e-a4bd-4bb5-827f-7de4fe93d261 req-ab290609-3d3e-411c-b362-ca5e18443f58 tempest-TestMinimumBasicScenario-248248190 None] attachment_update completed successfully.
Apr 29 10:33:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:33:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:33:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:33:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:33:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:33:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:33:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:05 devstack sudo[106027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:33:05 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:06 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.751s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:33:09 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:33:09 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:33:16 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-bbc6fb3a-fe9d-44ee-b941-2e3a61a8a902 req-74458263-41de-4ea7-b981-e4bd4f5cec5f tempest-AttachVolumeNegativeTest-1686417134 None] Terminate volume connection completed successfully.
Apr 29 10:33:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-bbc6fb3a-fe9d-44ee-b941-2e3a61a8a902 req-74458263-41de-4ea7-b981-e4bd4f5cec5f tempest-AttachVolumeNegativeTest-1686417134 None] Deleting attachment 316393ad-2d3c-4d1b-ab28-9e088075e183. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:33:26 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=2 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:33:26 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:33:29 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:33:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Flow 'volume_create_manager' (13d12a18-3214-4e66-b073-0b329b6c0ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:33:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc8ac58-06f6-4755-92a8-2ed6b5ff7a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:33:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc8ac58-06f6-4755-92a8-2ed6b5ff7a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-941339105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654b3702-6e8e-4b38-bf58-3b6ecffbc8e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fcedb6a0b1742b78513008666587fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:30Z,use_quota=True,user_id='2ae0d0f3a3974a3785f39da1e2b34424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:33:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64e14cb-0aa9-4976-a001-cbc93247e362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:33:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64e14cb-0aa9-4976-a001-cbc93247e362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:33:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd63b452-cfe6-414c-8727-b87108caa13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:33:29 devstack cinder-volume[84165]: DEBUG cinder.image.glance [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Creating Keystone auth plugin from conf {{(pid=84165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 10:33:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd63b452-cfe6-414c-8727-b87108caa13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '654b3702-6e8e-4b38-bf58-3b6ecffbc8e6', 'volume_name': 'volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f524632a960>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:33:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea600cb-fea7-419d-b059-4990d7d627ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:33:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea600cb-fea7-419d-b059-4990d7d627ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:33:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b7667b-ca81-476c-946c-66c5becfc414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:33:30 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Volume 654b3702-6e8e-4b38-bf58-3b6ecffbc8e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f524632a960>}
Apr 29 10:33:30 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Trying to clone 654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 from image 718e863a-88e0-4753-95be-273177fb3fd1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]). {{(pid=84165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 29 10:33:31 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f9tcd28udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 10:33:31 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 10:33:31 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c14a18-6ef8-433a-b492-9fb5eb1f4f85]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:33:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f9tcd28udevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:31 devstack sudo[106301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f9tcd28udevstack@QuobyteHD
Apr 29 10:33:31 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:31 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f9tcd28udevstack@QuobyteHD" returned: 0 in 0.722s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:31 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 is fetched for user 2ae0d0f3a3974a3785f39da1e2b34424. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 10:33:31 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7b0b14-3c9e-4867-951c-3a2f46b20c84]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:33:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f9tcd28udevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:32 devstack sudo[106308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f9tcd28udevstack@QuobyteHD
Apr 29 10:33:32 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:32 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f9tcd28udevstack@QuobyteHD" returned: 0 in 0.862s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:33:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:33:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-941339105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654b3702-6e8e-4b38-bf58-3b6ecffbc8e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fcedb6a0b1742b78513008666587fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:30Z,use_quota=True,user_id='2ae0d0f3a3974a3785f39da1e2b34424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:33:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Creating volume 654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:33:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:33:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:33:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:33:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:33:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:33:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:33:32 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:33:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:32 devstack sudo[106315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 1073741824
Apr 29 10:33:32 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:33 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 1073741824" returned: 0 in 0.929s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:33 devstack sudo[106321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6
Apr 29 10:33:33 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:34 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6" returned: 0 in 0.621s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:33:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:33:34 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Attempting download of 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume 654b3702-6e8e-4b38-bf58-3b6ecffbc8e6. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 10:33:34 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cb3630-f306-4e67-bb6a-0c413bec9afd]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:33:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_u3hri6rr {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:34 devstack sudo[106324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_u3hri6rr
Apr 29 10:33:34 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:35 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_u3hri6rr" returned: 0 in 0.735s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_u3hri6rr {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:35 devstack sudo[106328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_u3hri6rr
Apr 29 10:33:35 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:35 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_u3hri6rr" returned: 1 in 0.694s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_u3hri6rr' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:33:35 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4963392-d6bb-414a-909e-b214fc11a2bf]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:33:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f9tcd28udevstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:36 devstack sudo[106333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f9tcd28udevstack@QuobyteHD
Apr 29 10:33:36 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:36 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f9tcd28udevstack@QuobyteHD" returned: 0 in 0.689s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:36 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] 718e863a-88e0-4753-95be-273177fb3fd1 was qcow2, converting to raw {{(pid=84165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 10:33:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f9tcd28udevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:36 devstack sudo[106338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f9tcd28udevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6
Apr 29 10:33:36 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:38 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f9tcd28udevstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6" returned: 0 in 1.959s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:38 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_f9tcd28udevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:33:38 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Converted 112.00 MB image at 57.13 MB/s
Apr 29 10:33:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:38 devstack sudo[106347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 1G
Apr 29 10:33:38 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:39 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 1G" returned: 0 in 0.747s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:39 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e292d1aa-acd5-4009-980f-c5901b200a08]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:33:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:39 devstack sudo[106352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6
Apr 29 10:33:39 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:40 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6" returned: 0 in 0.777s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:40 devstack sudo[106372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6
Apr 29 10:33:40 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:40 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6" returned: 1 in 0.709s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:33:40 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Downloaded image 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume 654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 successfully. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 10:33:40 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 for user 2ae0d0f3a3974a3785f39da1e2b34424 is deleted. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 10:33:40 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Marking volume 654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 as bootable. {{(pid=84165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 10:33:40 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Copying metadata from image 718e863a-88e0-4753-95be-273177fb3fd1 to 654b3702-6e8e-4b38-bf58-3b6ecffbc8e6. {{(pid=84165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 10:33:40 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Creating volume glance metadata for volume 654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 backed by image 718e863a-88e0-4753-95be-273177fb3fd1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 10:33:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b7667b-ca81-476c-946c-66c5becfc414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f524632a960>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:33:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a16365a-8610-47d5-ac43-cb0a29eb0d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:33:40 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Volume volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 (654b3702-6e8e-4b38-bf58-3b6ecffbc8e6): created successfully
Apr 29 10:33:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a16365a-8610-47d5-ac43-cb0a29eb0d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:33:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Flow 'volume_create_manager' (13d12a18-3214-4e66-b073-0b329b6c0ce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:33:41 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-50ea4e97-2391-46d6-8f89-f67c886f712f tempest-TestShelveInstance-554008894 None] Created volume successfully.
Apr 29 10:33:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-b4373935-8bb5-40d7-90db-2d97f95fd1f8 req-83dd29c6-fb42-46bb-8bcc-8aa2f671f11d tempest-TestShelveInstance-554008894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:33:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-b4373935-8bb5-40d7-90db-2d97f95fd1f8 req-83dd29c6-fb42-46bb-8bcc-8aa2f671f11d tempest-TestShelveInstance-554008894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:33:49 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a88989c-813d-45a0-9504-02afd20545e2]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:33:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-b4373935-8bb5-40d7-90db-2d97f95fd1f8 req-83dd29c6-fb42-46bb-8bcc-8aa2f671f11d tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:49 devstack sudo[106460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6
Apr 29 10:33:49 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:50 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-b4373935-8bb5-40d7-90db-2d97f95fd1f8 req-83dd29c6-fb42-46bb-8bcc-8aa2f671f11d tempest-TestShelveInstance-554008894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6" returned: 0 in 0.905s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-b4373935-8bb5-40d7-90db-2d97f95fd1f8 req-83dd29c6-fb42-46bb-8bcc-8aa2f671f11d tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:50 devstack sudo[106465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6
Apr 29 10:33:50 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:51 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-b4373935-8bb5-40d7-90db-2d97f95fd1f8 req-83dd29c6-fb42-46bb-8bcc-8aa2f671f11d tempest-TestShelveInstance-554008894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6" returned: 1 in 1.289s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-b4373935-8bb5-40d7-90db-2d97f95fd1f8 req-83dd29c6-fb42-46bb-8bcc-8aa2f671f11d tempest-TestShelveInstance-554008894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:33:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-b4373935-8bb5-40d7-90db-2d97f95fd1f8 req-83dd29c6-fb42-46bb-8bcc-8aa2f671f11d tempest-TestShelveInstance-554008894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.263s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:33:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-b4373935-8bb5-40d7-90db-2d97f95fd1f8 req-83dd29c6-fb42-46bb-8bcc-8aa2f671f11d tempest-TestShelveInstance-554008894 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff399368-7e81-4b96-ba38-ffbdb998f2de', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:33:51 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-b4373935-8bb5-40d7-90db-2d97f95fd1f8 req-83dd29c6-fb42-46bb-8bcc-8aa2f671f11d tempest-TestShelveInstance-554008894 None] attachment_update completed successfully.
Apr 29 10:33:52 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-9a205b07-ed97-4077-82fc-f53a6ee15895 req-d9e6eb4b-7dfb-47c7-8a9f-99e8441ca532 tempest-TestMinimumBasicScenario-248248190 None] Terminate volume connection completed successfully.
Apr 29 10:33:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-9a205b07-ed97-4077-82fc-f53a6ee15895 req-d9e6eb4b-7dfb-47c7-8a9f-99e8441ca532 tempest-TestMinimumBasicScenario-248248190 None] Deleting attachment 1aea1279-9069-4a41-a6f5-d717122a6aeb. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:33:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Acquiring lock "cinder-35f7083d-0b4f-466f-919f-1217e17c0d26-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:33:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Lock "cinder-35f7083d-0b4f-466f-919f-1217e17c0d26-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:33:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Acquiring lock "cinder-quobyte-35f7083d-0b4f-466f-919f-1217e17c0d26" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:33:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Lock "cinder-quobyte-35f7083d-0b4f-466f-919f-1217e17c0d26" acquired by "delete_volume" :: waited 0.024s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:33:54 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb4cc45-3580-4b5b-a46c-5f1c6506007e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:33:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-35f7083d-0b4f-466f-919f-1217e17c0d26 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:54 devstack sudo[106507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-35f7083d-0b4f-466f-919f-1217e17c0d26
Apr 29 10:33:54 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:55 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-35f7083d-0b4f-466f-919f-1217e17c0d26" returned: 0 in 0.808s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-35f7083d-0b4f-466f-919f-1217e17c0d26 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:55 devstack sudo[106550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-35f7083d-0b4f-466f-919f-1217e17c0d26
Apr 29 10:33:55 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:55 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-35f7083d-0b4f-466f-919f-1217e17c0d26" returned: 0 in 0.670s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Lock "cinder-quobyte-35f7083d-0b4f-466f-919f-1217e17c0d26" released by "delete_volume" :: held 1.536s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:33:55 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Created reservations ['5c2bd93c-0232-4823-bf2c-d636b4970630', 'c98a7a4a-3a66-44c9-8548-74d286bf713b', '588ed4cf-f9e4-474a-a026-efb8b073e3dd', '98c2cc38-a379-4f04-a44e-0255a3c7e719'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:33:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:33:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:33:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:33:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:33:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:33:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:33:55 devstack sudo[106557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:33:55 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:33:56 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root
Apr 29 10:33:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.729s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:33:56 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:33:56 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Deleted volume successfully.
Apr 29 10:33:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8e40807a-964f-4cd8-8934-1a4056cdcf08 tempest-TestMinimumBasicScenario-248248190 None] Lock "cinder-35f7083d-0b4f-466f-919f-1217e17c0d26-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:34:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:34:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:34:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:34:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:34:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:34:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:34:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:34:05 devstack sudo[106997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:34:05 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:34:05 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=23,cinder:UPDATE=15,cinder:INSERT=10,cinder:DELETE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:34:06 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root
Apr 29 10:34:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.654s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:34:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:34:06 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=13,cinder:SELECT=19,cinder:INSERT=8,cinder:DELETE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Flow 'volume_create_manager' (6d7cbf55-0baa-405b-bc40-4a232e45c23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4b4214-5ffb-420e-bdb4-a76f250e737a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4b4214-5ffb-420e-bdb4-a76f250e737a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-576170479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acdd19c-1d14-47ac-9ee4-1da05dca7345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652299132e054fc28310cdda8623b251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:12Z,use_quota=True,user_id='a5805bf0486c4222a2595c942f814a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd5bace-7cd8-46de-93f6-edc3606dfc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd5bace-7cd8-46de-93f6-edc3606dfc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feeb7418-2d58-47b4-98ef-992a21c11e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feeb7418-2d58-47b4-98ef-992a21c11e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4acdd19c-1d14-47ac-9ee4-1da05dca7345', 'volume_name': 'volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1349ca0-a386-4d59-b775-067d7ea38984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1349ca0-a386-4d59-b775-067d7ea38984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecb9b0d-9c72-4a37-b282-385c970d4a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:34:12 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Volume 4acdd19c-1d14-47ac-9ee4-1da05dca7345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345', 'volume_size': 1}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-576170479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acdd19c-1d14-47ac-9ee4-1da05dca7345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652299132e054fc28310cdda8623b251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:12Z,use_quota=True,user_id='a5805bf0486c4222a2595c942f814a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Creating volume 4acdd19c-1d14-47ac-9ee4-1da05dca7345 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:34:12 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:34:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:34:12 devstack sudo[107005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345 1073741824
Apr 29 10:34:12 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:34:13 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root
Apr 29 10:34:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345 1073741824" returned: 0 in 0.968s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:34:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:34:13 devstack sudo[107013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345
Apr 29 10:34:13 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:34:13 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root
Apr 29 10:34:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345" returned: 0 in 0.751s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:34:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:34:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:34:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecb9b0d-9c72-4a37-b282-385c970d4a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:34:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ba6460-323f-48ea-acb2-e48541062859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:34:13 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Volume volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345 (4acdd19c-1d14-47ac-9ee4-1da05dca7345): created successfully
Apr 29 10:34:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ba6460-323f-48ea-acb2-e48541062859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:34:13 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Flow 'volume_create_manager' (6d7cbf55-0baa-405b-bc40-4a232e45c23b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:34:13 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-6f83d23b-b8e7-42da-a965-4a0ca5690077 tempest-AttachVolumeNegativeTest-1686417134 None] Created volume successfully.
Apr 29 10:34:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-632dd62b-f019-4b2f-a4cf-b999a3ff94c0 req-ff96c74a-11e8-4963-b707-ef291a1c9073 tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:34:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-632dd62b-f019-4b2f-a4cf-b999a3ff94c0 req-ff96c74a-11e8-4963-b707-ef291a1c9073 tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:34:17 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ed6031-136c-4241-8ca4-cabb8efc26a2]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:34:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-632dd62b-f019-4b2f-a4cf-b999a3ff94c0 req-ff96c74a-11e8-4963-b707-ef291a1c9073 tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:34:17 devstack sudo[107111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345
Apr 29 10:34:17 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:34:18 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root
Apr 29 10:34:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-632dd62b-f019-4b2f-a4cf-b999a3ff94c0 req-ff96c74a-11e8-4963-b707-ef291a1c9073 tempest-AttachVolumeNegativeTest-1686417134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345" returned: 0 in 0.769s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:34:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-632dd62b-f019-4b2f-a4cf-b999a3ff94c0 req-ff96c74a-11e8-4963-b707-ef291a1c9073 tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.800s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:34:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-632dd62b-f019-4b2f-a4cf-b999a3ff94c0 req-ff96c74a-11e8-4963-b707-ef291a1c9073 tempest-AttachVolumeNegativeTest-1686417134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9f973d3-ad71-4a61-a0be-f98931d6522c', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:34:18 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-632dd62b-f019-4b2f-a4cf-b999a3ff94c0 req-ff96c74a-11e8-4963-b707-ef291a1c9073 tempest-AttachVolumeNegativeTest-1686417134 None] attachment_update completed successfully.
Apr 29 10:34:24 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-a409340a-fd0b-41ec-b5bb-d5d28de87045 req-e677e1a9-da7a-40be-9661-8d5a89ab746c tempest-AttachVolumeNegativeTest-1686417134 None] Terminate volume connection completed successfully.
Apr 29 10:34:24 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-a409340a-fd0b-41ec-b5bb-d5d28de87045 req-e677e1a9-da7a-40be-9661-8d5a89ab746c tempest-AttachVolumeNegativeTest-1686417134 None] Deleting attachment e9f973d3-ad71-4a61-a0be-f98931d6522c. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:34:28 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:34:34 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:34:36 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:34:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Flow 'volume_create_manager' (b11fa15f-b506-44bf-9207-08d6700bb5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0c82b0-5640-4270-80b3-8526ae6a37f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0c82b0-5640-4270-80b3-8526ae6a37f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1544476465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f2fa40-108a-452d-9ed1-844c1d5de999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54093aca67a545b2862552c216fa040d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:37Z,use_quota=True,user_id='f5755810a32c4a6f81966b6610f5dfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd8e725-4200-4aa2-9a87-0231bcfe3a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd8e725-4200-4aa2-9a87-0231bcfe3a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b524a19c-59c6-4936-b319-8551e4c3afff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b524a19c-59c6-4936-b319-8551e4c3afff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f2fa40-108a-452d-9ed1-844c1d5de999', 'volume_name': 'volume-c8f2fa40-108a-452d-9ed1-844c1d5de999', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0b8d9e-4583-482d-9edc-8d2b0b14574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0b8d9e-4583-482d-9edc-8d2b0b14574b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0160ce5a-57b3-470f-ba69-09beb23a9048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:34:37 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Volume c8f2fa40-108a-452d-9ed1-844c1d5de999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f2fa40-108a-452d-9ed1-844c1d5de999', 'volume_size': 1}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1544476465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f2fa40-108a-452d-9ed1-844c1d5de999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54093aca67a545b2862552c216fa040d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:37Z,use_quota=True,user_id='f5755810a32c4a6f81966b6610f5dfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Creating volume c8f2fa40-108a-452d-9ed1-844c1d5de999 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:34:37 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:34:37 devstack sudo[107267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 1073741824
Apr 29 10:34:37 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:34:37 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-5146e8e7-62e8-4f6c-be0a-21a51b30cb84 req-66459909-a21e-49b1-8ccc-ac29e63c2113 tempest-TestShelveInstance-554008894 None] Terminate volume connection completed successfully.
Apr 29 10:34:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-5146e8e7-62e8-4f6c-be0a-21a51b30cb84 req-66459909-a21e-49b1-8ccc-ac29e63c2113 tempest-TestShelveInstance-554008894 None] Deleting attachment ff399368-7e81-4b96-ba38-ffbdb998f2de. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:34:38 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root
Apr 29 10:34:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 1073741824" returned: 0 in 1.126s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:34:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:34:38 devstack sudo[107275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999
Apr 29 10:34:38 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:34:38 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root
Apr 29 10:34:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999" returned: 0 in 0.718s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:34:38 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:34:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:34:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0160ce5a-57b3-470f-ba69-09beb23a9048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f2fa40-108a-452d-9ed1-844c1d5de999', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:34:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9d8150-b35f-4061-9706-241b51da5165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:34:39 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Volume volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 (c8f2fa40-108a-452d-9ed1-844c1d5de999): created successfully
Apr 29 10:34:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9d8150-b35f-4061-9706-241b51da5165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:34:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Flow 'volume_create_manager' (b11fa15f-b506-44bf-9207-08d6700bb5be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:34:39 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0eafc221-b784-4f58-943a-de9c5c3b40ef tempest-TestStampPattern-2086329137 None] Created volume successfully.
Apr 29 10:34:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-e550bbc5-7132-4281-a6af-f2fa3505aa77 req-c989ba30-37ba-48ec-b5db-2d64f4811f2e tempest-TestShelveInstance-554008894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:34:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-e550bbc5-7132-4281-a6af-f2fa3505aa77 req-c989ba30-37ba-48ec-b5db-2d64f4811f2e tempest-TestShelveInstance-554008894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:34:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[db98fd8e-5c8b-447d-8c54-95bc336fb672]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:34:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e550bbc5-7132-4281-a6af-f2fa3505aa77 req-c989ba30-37ba-48ec-b5db-2d64f4811f2e tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:34:44 devstack sudo[107291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6
Apr 29 10:34:44 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:34:45 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root
Apr 29 10:34:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e550bbc5-7132-4281-a6af-f2fa3505aa77 req-c989ba30-37ba-48ec-b5db-2d64f4811f2e tempest-TestShelveInstance-554008894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6" returned: 0 in 0.753s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:34:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e550bbc5-7132-4281-a6af-f2fa3505aa77 req-c989ba30-37ba-48ec-b5db-2d64f4811f2e tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:34:45 devstack sudo[107295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6
Apr 29 10:34:45 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:34:46 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root
Apr 29 10:34:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e550bbc5-7132-4281-a6af-f2fa3505aa77 req-c989ba30-37ba-48ec-b5db-2d64f4811f2e tempest-TestShelveInstance-554008894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6" returned: 1 in 0.896s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:34:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e550bbc5-7132-4281-a6af-f2fa3505aa77 req-c989ba30-37ba-48ec-b5db-2d64f4811f2e tempest-TestShelveInstance-554008894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:34:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-e550bbc5-7132-4281-a6af-f2fa3505aa77 req-c989ba30-37ba-48ec-b5db-2d64f4811f2e tempest-TestShelveInstance-554008894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.717s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:34:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-e550bbc5-7132-4281-a6af-f2fa3505aa77 req-c989ba30-37ba-48ec-b5db-2d64f4811f2e tempest-TestShelveInstance-554008894 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc1469c2-0c10-49c1-81f4-3de4efb29d11', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:34:46 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-e550bbc5-7132-4281-a6af-f2fa3505aa77 req-c989ba30-37ba-48ec-b5db-2d64f4811f2e tempest-TestShelveInstance-554008894 None] attachment_update completed successfully.
Apr 29 10:34:56 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=6,cinder:SELECT=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:34:56 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:35:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:35:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:35:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:35:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:35:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:35:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:35:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:05 devstack sudo[107941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:35:05 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:06 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.769s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Flow 'volume_create_manager' (802595c5-3e72-46f5-ad97-0c4c3e2ef037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e4b37e-f94e-4b60-b3ad-e96f28885b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e4b37e-f94e-4b60-b3ad-e96f28885b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-694399747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a3e698-31e9-4fc6-9110-2b7e17f4399b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652299132e054fc28310cdda8623b251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:35:19Z,use_quota=True,user_id='a5805bf0486c4222a2595c942f814a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d87d63d-6b55-4cc4-a87c-3bd283f03e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d87d63d-6b55-4cc4-a87c-3bd283f03e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c89805-b1c0-469d-9a32-38461f518ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c89805-b1c0-469d-9a32-38461f518ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40a3e698-31e9-4fc6-9110-2b7e17f4399b', 'volume_name': 'volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1eabfe-992b-4f0b-8e3b-8062063fc11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1eabfe-992b-4f0b-8e3b-8062063fc11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57655d7e-a652-4bc7-9dd8-fc52915521f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:35:19 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Volume 40a3e698-31e9-4fc6-9110-2b7e17f4399b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b', 'volume_size': 1}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-694399747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a3e698-31e9-4fc6-9110-2b7e17f4399b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652299132e054fc28310cdda8623b251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:35:19Z,use_quota=True,user_id='a5805bf0486c4222a2595c942f814a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Creating volume 40a3e698-31e9-4fc6-9110-2b7e17f4399b {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:35:19 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:35:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:19 devstack sudo[107993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b 1073741824
Apr 29 10:35:19 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-54c06f2a-9f44-4335-83dd-f832cf938f00 req-c983bb72-689a-4597-822b-abdf9e7c30f9 tempest-TestStampPattern-2086329137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:35:20 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b 1073741824" returned: 0 in 0.829s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:20 devstack sudo[108007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b
Apr 29 10:35:20 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:21 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b" returned: 0 in 0.601s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:35:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:35:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-54c06f2a-9f44-4335-83dd-f832cf938f00 req-c983bb72-689a-4597-822b-abdf9e7c30f9 tempest-TestStampPattern-2086329137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.664s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:35:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57655d7e-a652-4bc7-9dd8-fc52915521f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:35:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d307ddd4-ad34-4973-b02c-3fac84fd7094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:35:21 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca1c105-8054-4f4a-a7d4-ae5f4894ed6b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:35:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-54c06f2a-9f44-4335-83dd-f832cf938f00 req-c983bb72-689a-4597-822b-abdf9e7c30f9 tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:21 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Volume volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b (40a3e698-31e9-4fc6-9110-2b7e17f4399b): created successfully
Apr 29 10:35:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d307ddd4-ad34-4973-b02c-3fac84fd7094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:35:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Flow 'volume_create_manager' (802595c5-3e72-46f5-ad97-0c4c3e2ef037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:35:21 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d19077e2-d5e2-440c-b1fa-37bc1b44da6f tempest-AttachVolumeNegativeTest-1686417134 None] Created volume successfully.
Apr 29 10:35:21 devstack sudo[108010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999
Apr 29 10:35:21 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:21 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-54c06f2a-9f44-4335-83dd-f832cf938f00 req-c983bb72-689a-4597-822b-abdf9e7c30f9 tempest-TestStampPattern-2086329137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999" returned: 0 in 0.724s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-54c06f2a-9f44-4335-83dd-f832cf938f00 req-c983bb72-689a-4597-822b-abdf9e7c30f9 tempest-TestStampPattern-2086329137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.752s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:35:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-54c06f2a-9f44-4335-83dd-f832cf938f00 req-c983bb72-689a-4597-822b-abdf9e7c30f9 tempest-TestStampPattern-2086329137 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-c8f2fa40-108a-452d-9ed1-844c1d5de999', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8854797b-ca97-43ba-ab33-9ef881ccf580', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:35:21 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-54c06f2a-9f44-4335-83dd-f832cf938f00 req-c983bb72-689a-4597-822b-abdf9e7c30f9 tempest-TestStampPattern-2086329137 None] attachment_update completed successfully.
Apr 29 10:35:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-da66ce0d-a212-4bfe-9b38-240a2452d57f req-73c989f6-6798-406b-a4ac-4a01ae7a340a tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:35:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-da66ce0d-a212-4bfe-9b38-240a2452d57f req-73c989f6-6798-406b-a4ac-4a01ae7a340a tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:35:24 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaf8f27-24d5-4bfc-8dee-37a6df4ab641]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:35:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-da66ce0d-a212-4bfe-9b38-240a2452d57f req-73c989f6-6798-406b-a4ac-4a01ae7a340a tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:24 devstack sudo[108034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b
Apr 29 10:35:24 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:25 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-da66ce0d-a212-4bfe-9b38-240a2452d57f req-73c989f6-6798-406b-a4ac-4a01ae7a340a tempest-AttachVolumeNegativeTest-1686417134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b" returned: 0 in 0.801s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-da66ce0d-a212-4bfe-9b38-240a2452d57f req-73c989f6-6798-406b-a4ac-4a01ae7a340a tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.816s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:35:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-da66ce0d-a212-4bfe-9b38-240a2452d57f req-73c989f6-6798-406b-a4ac-4a01ae7a340a tempest-AttachVolumeNegativeTest-1686417134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a1a0fde-2a18-42d4-825d-0d101feadcea', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:35:25 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-da66ce0d-a212-4bfe-9b38-240a2452d57f req-73c989f6-6798-406b-a4ac-4a01ae7a340a tempest-AttachVolumeNegativeTest-1686417134 None] attachment_update completed successfully.
Apr 29 10:35:30 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-0268d8f2-0164-4493-b493-a62a3e40bfed req-e243f903-42bf-4656-8071-e167091cc7c2 tempest-TestStampPattern-2086329137 None] Terminate volume connection completed successfully.
Apr 29 10:35:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-0268d8f2-0164-4493-b493-a62a3e40bfed req-e243f903-42bf-4656-8071-e167091cc7c2 tempest-TestStampPattern-2086329137 None] Deleting attachment 8854797b-ca97-43ba-ab33-9ef881ccf580. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:35:31 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-d1e426d7-6f19-4ceb-8b96-45c6ac1dbf59 req-8113e6d0-d72c-461c-8a6d-3393895ec40b tempest-AttachVolumeNegativeTest-1686417134 None] Terminate volume connection completed successfully.
Apr 29 10:35:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-d1e426d7-6f19-4ceb-8b96-45c6ac1dbf59 req-8113e6d0-d72c-461c-8a6d-3393895ec40b tempest-AttachVolumeNegativeTest-1686417134 None] Deleting attachment 5a1a0fde-2a18-42d4-825d-0d101feadcea. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:35:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:35:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:35:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] Creating offline snapshot 834d3baf-5aad-4613-b60d-b04cfdd10337 of volume c8f2fa40-108a-452d-9ed1-844c1d5de999 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:35:32 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24c8db8-518b-43e6-b3cb-b16dd715449b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:35:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:32 devstack sudo[108118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999
Apr 29 10:35:32 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:33 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999" returned: 0 in 0.704s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:33 devstack sudo[108123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337 1G
Apr 29 10:35:33 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:33 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337 1G" returned: 0 in 0.756s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:34 devstack sudo[108130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337
Apr 29 10:35:34 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:34 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337" returned: 0 in 0.755s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:34 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337 is being set with open permissions: ugo+rw
Apr 29 10:35:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:34 devstack sudo[108173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337
Apr 29 10:35:34 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:35 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337" returned: 0 in 0.663s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:35 devstack sudo[108178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.info
Apr 29 10:35:35 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:36 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.info" returned: 0 in 0.628s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:36 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.info is being set with open permissions: ugo+rw
Apr 29 10:35:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:36 devstack sudo[108181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.info
Apr 29 10:35:36 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:36 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.info" returned: 0 in 0.656s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.244s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:35:36 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-05af9560-8fab-4a4f-978f-525cd233b23b tempest-TestStampPattern-2086329137 None] Create snapshot completed successfully
Apr 29 10:35:42 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "cinder-40a3e698-31e9-4fc6-9110-2b7e17f4399b-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:35:42 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Lock "cinder-40a3e698-31e9-4fc6-9110-2b7e17f4399b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:35:42 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "cinder-quobyte-40a3e698-31e9-4fc6-9110-2b7e17f4399b" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:35:42 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Lock "cinder-quobyte-40a3e698-31e9-4fc6-9110-2b7e17f4399b" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:35:42 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa143de-370b-4309-8a51-ac9436e1657d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:35:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:42 devstack sudo[108242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b
Apr 29 10:35:42 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:42 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b" returned: 0 in 0.825s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:43 devstack sudo[108269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b
Apr 29 10:35:43 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:43 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-40a3e698-31e9-4fc6-9110-2b7e17f4399b" returned: 0 in 0.596s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Lock "cinder-quobyte-40a3e698-31e9-4fc6-9110-2b7e17f4399b" released by "delete_volume" :: held 1.469s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:35:43 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Created reservations ['78f9ea32-31c8-45a5-b0ba-f659237977d6', '5793355a-af90-4218-8432-2207cffb7f29', '677e9add-2440-4c70-9d4e-b6ce7fa2e60b', '31041e3a-610d-46b6-8d42-542bdcdcbfd1'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:35:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:35:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:35:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:35:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:35:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:35:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:43 devstack sudo[108273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:35:43 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:43 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-458784d0-0fcb-4948-98f1-3ca074ae7931 tempest-TestShelveInstance-554008894 None] Terminate volume connection completed successfully.
Apr 29 10:35:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-458784d0-0fcb-4948-98f1-3ca074ae7931 tempest-TestShelveInstance-554008894 None] Deleting attachment cc1469c2-0c10-49c1-81f4-3de4efb29d11. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:35:44 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.623s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:44 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:35:44 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Deleted volume successfully.
Apr 29 10:35:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a26d3c2-0706-49ca-85e4-7240b5bd669d tempest-AttachVolumeNegativeTest-1686417134 None] Lock "cinder-40a3e698-31e9-4fc6-9110-2b7e17f4399b-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:35:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "cinder-4acdd19c-1d14-47ac-9ee4-1da05dca7345-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:35:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Lock "cinder-4acdd19c-1d14-47ac-9ee4-1da05dca7345-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:35:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "cinder-quobyte-4acdd19c-1d14-47ac-9ee4-1da05dca7345" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:35:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Lock "cinder-quobyte-4acdd19c-1d14-47ac-9ee4-1da05dca7345" acquired by "delete_volume" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:35:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad3705d-9f98-4dc4-a2db-b58827e44845]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:35:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Acquiring lock "cinder-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:35:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Lock "cinder-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:35:44 devstack sudo[108276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345
Apr 29 10:35:44 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Acquiring lock "cinder-quobyte-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:35:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Lock "cinder-quobyte-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:35:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c966d0-342f-457a-8663-7efc07907d90]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:35:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:44 devstack sudo[108278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6
Apr 29 10:35:44 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:45 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345" returned: 0 in 0.912s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:45 devstack sudo[108283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345
Apr 29 10:35:45 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:45 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6" returned: 0 in 0.873s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:45 devstack sudo[108287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6
Apr 29 10:35:45 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:46 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4acdd19c-1d14-47ac-9ee4-1da05dca7345" returned: 0 in 0.685s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Lock "cinder-quobyte-4acdd19c-1d14-47ac-9ee4-1da05dca7345" released by "delete_volume" :: held 1.650s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Created reservations ['b2f62269-23e8-4ff3-af9e-de50736fe398', '62ac648c-3178-4352-8975-da6107cbd243', 'd377bc2e-f657-4d71-9ccc-5cc45de3c412', 'a135e501-c9b9-465b-80af-b6d843f90282'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:46 devstack sudo[108290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:35:46 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:46 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6" returned: 1 in 0.901s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:46 devstack sudo[108295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6
Apr 29 10:35:46 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "cinder-2803b2a8-3870-477c-bf0b-0f7da86bfd23-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Lock "cinder-2803b2a8-3870-477c-bf0b-0f7da86bfd23-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "cinder-quobyte-2803b2a8-3870-477c-bf0b-0f7da86bfd23" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:35:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Lock "cinder-quobyte-2803b2a8-3870-477c-bf0b-0f7da86bfd23" acquired by "delete_volume" :: waited 0.028s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e460790e-542f-4f74-bd56-b2d4ea2cbd9d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:47 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.847s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:35:47 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Deleted volume successfully.
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7c7041e7-2684-4926-be8c-68a7c05f8817 tempest-AttachVolumeNegativeTest-1686417134 None] Lock "cinder-4acdd19c-1d14-47ac-9ee4-1da05dca7345-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:35:47 devstack sudo[108298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23
Apr 29 10:35:47 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:47 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6" returned: 0 in 0.824s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Lock "cinder-quobyte-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6" released by "delete_volume" :: held 2.672s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG cinder.quota [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Created reservations ['04d120f8-6ce0-4474-b6c2-2fce0e49f72f', 'decae6e4-807d-430e-9f33-4e37ef0420a4', 'b783ec95-af5c-4a82-85c5-e914a79a2238', '8a10e691-ab5f-4512-9c0e-c81e47ed6a7e'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:47 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:35:47 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Flow 'volume_create_manager' (cf0eda0e-422a-4efd-af90-c36f889a35f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9056388-c4d7-4902-a520-4da964a839b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:35:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9056388-c4d7-4902-a520-4da964a839b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1894394184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d4bfec-96d3-4bf2-9286-63f6a7838f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54093aca67a545b2862552c216fa040d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=834d3baf-5aad-4613-b60d-b04cfdd10337,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:35:48Z,use_quota=True,user_id='f5755810a32c4a6f81966b6610f5dfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345eac2d-3988-4959-97f1-138946e524ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345eac2d-3988-4959-97f1-138946e524ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924d4145-462b-4ec6-8d29-813f7619cd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924d4145-462b-4ec6-8d29-813f7619cd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '94d4bfec-96d3-4bf2-9286-63f6a7838f90', 'volume_name': 'volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90', 'volume_size': 1, 'snapshot_id': '834d3baf-5aad-4613-b60d-b04cfdd10337'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cd7094-1e33-4e94-94fb-957d503c2e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cd7094-1e33-4e94-94fb-957d503c2e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f16a59-4ac6-40bd-86ee-300773e1905c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:35:48 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Volume 94d4bfec-96d3-4bf2-9286-63f6a7838f90: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90', 'volume_size': 1, 'snapshot_id': '834d3baf-5aad-4613-b60d-b04cfdd10337'}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Acquiring lock "cinder-quobyte-834d3baf-5aad-4613-b60d-b04cfdd10337-94d4bfec-96d3-4bf2-9286-63f6a7838f90" by "_create_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Lock "cinder-quobyte-834d3baf-5aad-4613-b60d-b04cfdd10337-94d4bfec-96d3-4bf2-9286-63f6a7838f90" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Creating volume 94d4bfec-96d3-4bf2-9286-63f6a7838f90 from snapshot 834d3baf-5aad-4613-b60d-b04cfdd10337 {{(pid=84165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:35:48 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Acquiring lock "cinder-quobyte-94d4bfec-96d3-4bf2-9286-63f6a7838f90" by "_copy_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23" returned: 0 in 1.062s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Lock "cinder-quobyte-94d4bfec-96d3-4bf2-9286-63f6a7838f90" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] snapshot: 834d3baf-5aad-4613-b60d-b04cfdd10337, volume: 94d4bfec-96d3-4bf2-9286-63f6a7838f90,  {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 10:35:48 devstack sudo[108306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23
Apr 29 10:35:48 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4dccb3-68a0-486d-be13-6d8e018eb1ab]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:48 devstack sudo[108308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337
Apr 29 10:35:48 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:48 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.932s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.manager [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:35:48 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Deleted volume successfully.
Apr 29 10:35:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-ad716b3e-933c-4cf6-b88f-d5a57a17ade8 req-3b8c051f-222a-48f4-9910-e70daa55bd01 tempest-TestShelveInstance-554008894 None] Lock "cinder-654b3702-6e8e-4b38-bf58-3b6ecffbc8e6-delete_volume" released by "delete_volume" :: held 4.038s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:35:49 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2803b2a8-3870-477c-bf0b-0f7da86bfd23" returned: 0 in 0.930s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Lock "cinder-quobyte-2803b2a8-3870-477c-bf0b-0f7da86bfd23" released by "delete_volume" :: held 2.078s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:35:49 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Created reservations ['62be8839-0d7a-41c8-ac0a-2f0908b85b10', 'd4be019d-5adc-4d7c-9b42-9e108078e8f7', '3f1f61a0-2250-4e39-b14b-4ecd86b7c1de', '34def875-d18a-4666-b9f9-c99f541d961a'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:35:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:35:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:35:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:35:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:35:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:35:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:49 devstack sudo[108317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:35:49 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:49 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337" returned: 0 in 1.166s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8f2fa40-108a-452d-9ed1-844c1d5de999(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:35:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 10:35:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Creating direct copy from snapshot {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 10:35:49 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca22bee-97eb-4095-8997-622ec75cd363]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:35:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:49 devstack sudo[108319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999
Apr 29 10:35:49 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:50 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.994s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:50 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:35:50 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Deleted volume successfully.
Apr 29 10:35:50 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-d2c5408f-0e08-4e12-96ae-2f77a1168d0b tempest-AttachVolumeNegativeTest-1686417134 None] Lock "cinder-2803b2a8-3870-477c-bf0b-0f7da86bfd23-delete_volume" released by "delete_volume" :: held 3.408s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:35:50 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999" returned: 0 in 1.010s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:50 devstack cinder-volume[84165]: DEBUG cinder.utils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Path /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90 not found in is_blk_device check {{(pid=84165) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 10:35:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:50 devstack sudo[108327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90
Apr 29 10:35:50 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:56 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90" returned: 0 in 6.260s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:56 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a68982-01a6-4db0-93fe-b8303ff3da7b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:35:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:56 devstack sudo[108343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999
Apr 29 10:35:56 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:57 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999" returned: 0 in 1.218s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:57 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:35:57 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Converted 1024.00 MB image at 163.48 MB/s
Apr 29 10:35:57 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90 is being set with open permissions: ugo+rw
Apr 29 10:35:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:35:57 devstack sudo[108348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90
Apr 29 10:35:57 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:35:58 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root
Apr 29 10:35:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90" returned: 0 in 0.890s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:35:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Lock "cinder-quobyte-94d4bfec-96d3-4bf2-9286-63f6a7838f90" released by "_copy_volume_from_snapshot" :: held 10.718s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:35:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Lock "cinder-quobyte-834d3baf-5aad-4613-b60d-b04cfdd10337-94d4bfec-96d3-4bf2-9286-63f6a7838f90" released by "_create_volume_from_snapshot" :: held 10.801s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:35:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.826s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:35:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f16a59-4ac6-40bd-86ee-300773e1905c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90', 'volume_size': 1, 'snapshot_id': '834d3baf-5aad-4613-b60d-b04cfdd10337'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:35:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d048379e-b3cc-4e4a-82cf-7b6388f4a394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:35:58 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Volume volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90 (94d4bfec-96d3-4bf2-9286-63f6a7838f90): created successfully
Apr 29 10:35:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d048379e-b3cc-4e4a-82cf-7b6388f4a394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:35:59 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Flow 'volume_create_manager' (cf0eda0e-422a-4efd-af90-c36f889a35f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:35:59 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1d246940-ebbb-4ae1-978c-2bc70681fdeb tempest-TestStampPattern-2086329137 None] Created volume successfully.
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Flow 'volume_create_manager' (ad0d819c-8a45-4e32-b52f-727ea06fe1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a756bb-a91b-4efd-8758-a9a10a7b806c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a756bb-a91b-4efd-8758-a9a10a7b806c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-355353811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd18954-7b65-4e5b-af8a-5a319503629e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4823544c6364c41be64a5bf4700501a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:04Z,use_quota=True,user_id='65e7feb732e04d1eb90ca919521e4b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5b31cc-2192-4723-8b63-b6e0643a8931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5b31cc-2192-4723-8b63-b6e0643a8931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a822bb7-8fd0-4d12-bab6-5707498a3b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a822bb7-8fd0-4d12-bab6-5707498a3b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dd18954-7b65-4e5b-af8a-5a319503629e', 'volume_name': 'volume-1dd18954-7b65-4e5b-af8a-5a319503629e', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20f92fc-16d9-4f69-b8a7-6f1765340eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20f92fc-16d9-4f69-b8a7-6f1765340eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6013f748-8b61-4924-97bd-09323f4066ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:04 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Volume 1dd18954-7b65-4e5b-af8a-5a319503629e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dd18954-7b65-4e5b-af8a-5a319503629e', 'volume_size': 1}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-355353811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd18954-7b65-4e5b-af8a-5a319503629e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4823544c6364c41be64a5bf4700501a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:04Z,use_quota=True,user_id='65e7feb732e04d1eb90ca919521e4b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Creating volume 1dd18954-7b65-4e5b-af8a-5a319503629e {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:36:04 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:36:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:04 devstack sudo[108383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e 1073741824
Apr 29 10:36:04 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:05 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e 1073741824" returned: 0 in 0.969s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:05 devstack sudo[108392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e
Apr 29 10:36:05 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:36:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:05 devstack sudo[108394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:36:05 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:06 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e" returned: 0 in 0.658s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6013f748-8b61-4924-97bd-09323f4066ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dd18954-7b65-4e5b-af8a-5a319503629e', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7b7a1d-00ad-4449-9209-fe270fdc2d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:06 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Volume volume-1dd18954-7b65-4e5b-af8a-5a319503629e (1dd18954-7b65-4e5b-af8a-5a319503629e): created successfully
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7b7a1d-00ad-4449-9209-fe270fdc2d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Flow 'volume_create_manager' (ad0d819c-8a45-4e32-b52f-727ea06fe1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:06 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-e56d0da9-a7d7-4908-94a1-52ed7f35bad5 req-2048a373-122c-46c7-b928-fead256b9472 tempest-VolumesSnapshotsTestJSON-1559500654 None] Created volume successfully.
Apr 29 10:36:06 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.606s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=38,cinder:UPDATE=56,cinder:DELETE=5,cinder:INSERT=6 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=35,cinder:SELECT=52,cinder:INSERT=13,cinder:DELETE=3 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Flow 'volume_create_manager' (6b904117-7d65-4f67-8ec2-9a581262b561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da90cbac-c640-4b36-876e-db4a1a47b165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da90cbac-c640-4b36-876e-db4a1a47b165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1608797174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7858ea0b-a3f1-4382-80c3-27b6d42aa7fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e196bb5afb49099f83303867deaafc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:06Z,use_quota=True,user_id='59b9e5cb9b5b43c5aa2279ae59d32550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329a65f4-44fb-411e-8bd1-a86fcadf9462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329a65f4-44fb-411e-8bd1-a86fcadf9462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda1590a-0225-4fef-ae1c-cf81125d3ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda1590a-0225-4fef-ae1c-cf81125d3ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7858ea0b-a3f1-4382-80c3-27b6d42aa7fa', 'volume_name': 'volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37da9287-98c2-4421-b622-d797a0978e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37da9287-98c2-4421-b622-d797a0978e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827805b8-320d-4bbc-ac2a-af28b60c1b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:06 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Volume 7858ea0b-a3f1-4382-80c3-27b6d42aa7fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa', 'volume_size': 1}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1608797174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7858ea0b-a3f1-4382-80c3-27b6d42aa7fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e196bb5afb49099f83303867deaafc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:06Z,use_quota=True,user_id='59b9e5cb9b5b43c5aa2279ae59d32550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Creating volume 7858ea0b-a3f1-4382-80c3-27b6d42aa7fa {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:36:06 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:36:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:06 devstack sudo[108434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa 1073741824
Apr 29 10:36:06 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:07 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:36:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Flow 'volume_create_manager' (04c177dc-5ab3-42f3-a46a-5ce648e6875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4a265d-ea06-4f53-b50d-4b044c968114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4a265d-ea06-4f53-b50d-4b044c968114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-640857789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5786f60-4ed1-41b9-9479-53e620d647e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e196bb5afb49099f83303867deaafc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:07Z,use_quota=True,user_id='59b9e5cb9b5b43c5aa2279ae59d32550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d15bf0-aa9e-45a1-8307-f20ff174dd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d15bf0-aa9e-45a1-8307-f20ff174dd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccea0af-d13c-4852-a6ce-816287aafa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccea0af-d13c-4852-a6ce-816287aafa8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5786f60-4ed1-41b9-9479-53e620d647e1', 'volume_name': 'volume-a5786f60-4ed1-41b9-9479-53e620d647e1', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82adec13-0e6f-4d5a-a365-63c2525050a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82adec13-0e6f-4d5a-a365-63c2525050a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8dc975d-3c60-43cb-b9b5-11cc349ae486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:07 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Volume a5786f60-4ed1-41b9-9479-53e620d647e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5786f60-4ed1-41b9-9479-53e620d647e1', 'volume_size': 1}
Apr 29 10:36:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:07 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Flow 'volume_create_manager' (2f59ed56-a702-4d8c-84a5-5b061e321630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a366b6a6-c976-42be-b843-193dbf82309e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a366b6a6-c976-42be-b843-193dbf82309e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1064303488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b0136b-1dce-4c46-96bd-64d863204045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e196bb5afb49099f83303867deaafc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:08Z,use_quota=True,user_id='59b9e5cb9b5b43c5aa2279ae59d32550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839fbb2b-3288-4aeb-ab4c-ee2016fd56a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839fbb2b-3288-4aeb-ab4c-ee2016fd56a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1173f337-20d0-455d-ae15-d4e3d8cde021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1173f337-20d0-455d-ae15-d4e3d8cde021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49b0136b-1dce-4c46-96bd-64d863204045', 'volume_name': 'volume-49b0136b-1dce-4c46-96bd-64d863204045', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd15c0b-b936-4121-a397-d14bbbff2ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd15c0b-b936-4121-a397-d14bbbff2ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b8a54f-d226-4523-aa0e-521d80563e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:08 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Volume 49b0136b-1dce-4c46-96bd-64d863204045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49b0136b-1dce-4c46-96bd-64d863204045', 'volume_size': 1}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:08 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa 1073741824" returned: 0 in 1.577s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:08 devstack sudo[108444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa
Apr 29 10:36:08 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Flow 'volume_create_manager' (d44f6568-aee8-4f9d-b0a0-1e40b37b4be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c15613c-628d-4433-9f9a-dab7f0b69d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c15613c-628d-4433-9f9a-dab7f0b69d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-975549348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35a2b8b-fd2c-45f9-ab95-11c540aec924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e196bb5afb49099f83303867deaafc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:08Z,use_quota=True,user_id='59b9e5cb9b5b43c5aa2279ae59d32550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc9f16b-4120-4597-b37f-37c8b06036b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc9f16b-4120-4597-b37f-37c8b06036b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e924bb-9e5e-4d35-bd2d-79ed7d9dd786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e924bb-9e5e-4d35-bd2d-79ed7d9dd786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a35a2b8b-fd2c-45f9-ab95-11c540aec924', 'volume_name': 'volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb63e35-3c1d-4d0e-b898-680056e942a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb63e35-3c1d-4d0e-b898-680056e942a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44fab27-9030-45cc-9bdb-8ab799529292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:08 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Volume a35a2b8b-fd2c-45f9-ab95-11c540aec924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924', 'volume_size': 1}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Flow 'volume_create_manager' (540345ca-ae38-4984-a7a7-e7bbb0a00deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44eed5e0-a804-429e-a657-38fb215e5c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44eed5e0-a804-429e-a657-38fb215e5c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-349759848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6aaf152-0edd-45f5-8a10-a8da42392cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e196bb5afb49099f83303867deaafc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:09Z,use_quota=True,user_id='59b9e5cb9b5b43c5aa2279ae59d32550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264e12b0-05d1-4ffb-bc9a-80b1cfe0a199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264e12b0-05d1-4ffb-bc9a-80b1cfe0a199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d148ce-9482-4959-9c17-6750e7eab699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d148ce-9482-4959-9c17-6750e7eab699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6aaf152-0edd-45f5-8a10-a8da42392cce', 'volume_name': 'volume-c6aaf152-0edd-45f5-8a10-a8da42392cce', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d32094a-0418-42a4-8e80-144929bf32ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d32094a-0418-42a4-8e80-144929bf32ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b713c2-bff0-4fab-a77f-305123a1c470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:08 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Volume c6aaf152-0edd-45f5-8a10-a8da42392cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6aaf152-0edd-45f5-8a10-a8da42392cce', 'volume_size': 1}
Apr 29 10:36:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:09 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa" returned: 0 in 0.767s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] <== create_volume: return (2419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:36:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.429s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.777s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] Creating offline snapshot cf005c20-0dc0-423b-ad95-d081cdca8fce of volume 1dd18954-7b65-4e5b-af8a-5a319503629e {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:36:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827805b8-320d-4bbc-ac2a-af28b60c1b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5eacd6-faf1-48f3-909f-d4b816a3a120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:09 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[921e7923-f437-4027-b775-49938c977317]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:09 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Volume volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa (7858ea0b-a3f1-4382-80c3-27b6d42aa7fa): created successfully
Apr 29 10:36:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5eacd6-faf1-48f3-909f-d4b816a3a120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Flow 'volume_create_manager' (6b904117-7d65-4f67-8ec2-9a581262b561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:09 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-2e1499f5-345e-404f-9d30-c671ae12d6d2 tempest-CreateVolumesFromImageTest-607934403 None] Created volume successfully.
Apr 29 10:36:09 devstack sudo[108447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e
Apr 29 10:36:09 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:09 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e" returned: 0 in 0.769s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:09 devstack sudo[108452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce 1G
Apr 29 10:36:09 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:10 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce 1G" returned: 0 in 0.867s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd18954-7b65-4e5b-af8a-5a319503629e -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:10 devstack sudo[108457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd18954-7b65-4e5b-af8a-5a319503629e -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce
Apr 29 10:36:10 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:11 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd18954-7b65-4e5b-af8a-5a319503629e -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce" returned: 0 in 0.682s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:11 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce is being set with open permissions: ugo+rw
Apr 29 10:36:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:11 devstack sudo[108463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce
Apr 29 10:36:11 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:11 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce" returned: 0 in 0.616s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:12 devstack sudo[108466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.info
Apr 29 10:36:12 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:12 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.info" returned: 0 in 0.742s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:12 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.info is being set with open permissions: ugo+rw
Apr 29 10:36:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:12 devstack sudo[108471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.info
Apr 29 10:36:12 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:13 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.info" returned: 0 in 0.632s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.419s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.968s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-640857789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5786f60-4ed1-41b9-9479-53e620d647e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e196bb5afb49099f83303867deaafc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:07Z,use_quota=True,user_id='59b9e5cb9b5b43c5aa2279ae59d32550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:36:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Creating volume a5786f60-4ed1-41b9-9479-53e620d647e1 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:36:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:36:13 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:36:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a5786f60-4ed1-41b9-9479-53e620d647e1 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:13 devstack sudo[108474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a5786f60-4ed1-41b9-9479-53e620d647e1 1073741824
Apr 29 10:36:13 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:13 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-d08a9762-b510-4c42-abc7-0420603e8b17 req-b1d62b50-ccf3-458c-b723-2b188cf81723 tempest-VolumesSnapshotsTestJSON-1559500654 None] Create snapshot completed successfully
Apr 29 10:36:14 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a5786f60-4ed1-41b9-9479-53e620d647e1 1073741824" returned: 0 in 0.888s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Acquiring lock "cinder-cf005c20-0dc0-423b-ad95-d081cdca8fce-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "cinder-cf005c20-0dc0-423b-ad95-d081cdca8fce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Acquiring lock "cinder-quobyte-1dd18954-7b65-4e5b-af8a-5a319503629e" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a5786f60-4ed1-41b9-9479-53e620d647e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "cinder-quobyte-1dd18954-7b65-4e5b-af8a-5a319503629e" acquired by "delete_snapshot" :: waited 0.036s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Acquiring lock "cinder-quobyte-cf005c20-0dc0-423b-ad95-d081cdca8fce" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:14 devstack sudo[108480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a5786f60-4ed1-41b9-9479-53e620d647e1
Apr 29 10:36:14 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "cinder-quobyte-cf005c20-0dc0-423b-ad95-d081cdca8fce" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:14 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Deleting offline snapshot cf005c20-0dc0-423b-ad95-d081cdca8fce of volume 1dd18954-7b65-4e5b-af8a-5a319503629e {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:36:14 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] snapshot_file for this snap is: volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:36:14 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8718ac0b-afa5-4fa3-afb2-170de847406c]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:14 devstack sudo[108482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce
Apr 29 10:36:14 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:15 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a5786f60-4ed1-41b9-9479-53e620d647e1" returned: 0 in 0.669s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.989s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1064303488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b0136b-1dce-4c46-96bd-64d863204045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e196bb5afb49099f83303867deaafc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:08Z,use_quota=True,user_id='59b9e5cb9b5b43c5aa2279ae59d32550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Creating volume 49b0136b-1dce-4c46-96bd-64d863204045 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:36:15 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-49b0136b-1dce-4c46-96bd-64d863204045 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8dc975d-3c60-43cb-b9b5-11cc349ae486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5786f60-4ed1-41b9-9479-53e620d647e1', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:15 devstack sudo[108485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-49b0136b-1dce-4c46-96bd-64d863204045 1073741824
Apr 29 10:36:15 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13a26d0-a310-4edf-a748-5a676342e87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:15 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Volume volume-a5786f60-4ed1-41b9-9479-53e620d647e1 (a5786f60-4ed1-41b9-9479-53e620d647e1): created successfully
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13a26d0-a310-4edf-a748-5a676342e87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Flow 'volume_create_manager' (04c177dc-5ab3-42f3-a46a-5ce648e6875c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:15 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-ef2f7dba-086c-46d0-8bf9-2c5b76987494 tempest-CreateVolumesFromImageTest-607934403 None] Created volume successfully.
Apr 29 10:36:15 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce" returned: 0 in 0.788s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dd18954-7b65-4e5b-af8a-5a319503629e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[713f9df8-5bb3-4f05-bc57-0f534aec01f9]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:15 devstack sudo[108490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e
Apr 29 10:36:15 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:16 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-49b0136b-1dce-4c46-96bd-64d863204045 1073741824" returned: 0 in 0.901s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-49b0136b-1dce-4c46-96bd-64d863204045 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:16 devstack sudo[108499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-49b0136b-1dce-4c46-96bd-64d863204045
Apr 29 10:36:16 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:16 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e" returned: 0 in 0.790s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:16 devstack sudo[108501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce
Apr 29 10:36:16 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:16 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-49b0136b-1dce-4c46-96bd-64d863204045" returned: 0 in 0.660s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.145s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-975549348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35a2b8b-fd2c-45f9-ab95-11c540aec924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e196bb5afb49099f83303867deaafc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:08Z,use_quota=True,user_id='59b9e5cb9b5b43c5aa2279ae59d32550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Creating volume a35a2b8b-fd2c-45f9-ab95-11c540aec924 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:36:16 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:16 devstack sudo[108507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924 1073741824
Apr 29 10:36:16 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b8a54f-d226-4523-aa0e-521d80563e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b0136b-1dce-4c46-96bd-64d863204045', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c244553-8447-44b8-8b1b-773a483cad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:16 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Volume volume-49b0136b-1dce-4c46-96bd-64d863204045 (49b0136b-1dce-4c46-96bd-64d863204045): created successfully
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c244553-8447-44b8-8b1b-773a483cad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Flow 'volume_create_manager' (2f59ed56-a702-4d8c-84a5-5b061e321630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:16 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-cc0d7651-9209-456f-94c6-cece5808b8c2 tempest-CreateVolumesFromImageTest-607934403 None] Created volume successfully.
Apr 29 10:36:16 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce" returned: 0 in 0.712s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:16 devstack sudo[108509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce
Apr 29 10:36:16 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:17 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e.cf005c20-0dc0-423b-ad95-d081cdca8fce" returned: 0 in 0.643s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:17 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "cinder-quobyte-cf005c20-0dc0-423b-ad95-d081cdca8fce" released by "_delete_snapshot" :: held 3.052s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:17 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "cinder-quobyte-1dd18954-7b65-4e5b-af8a-5a319503629e" released by "delete_snapshot" :: held 3.089s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:17 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924 1073741824" returned: 0 in 0.839s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:17 devstack cinder-volume[84165]: DEBUG cinder.quota [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Created reservations ['8dd97745-bc43-4a12-874b-2c656054951b', '8f0b7c32-8d77-4d01-9706-b6db5883e04b', '6fd4a791-95a6-4d7a-97b6-a1e0194e2ec5', 'a4eaff3b-022a-4c05-8369-dd14b696832b'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:36:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:17 devstack sudo[108515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924
Apr 29 10:36:17 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:17 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Delete snapshot completed successfully.
Apr 29 10:36:17 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-e5834008-07b3-429c-a2ba-7d60e567ed19 req-dc092ae2-1773-4039-b00e-95caf931c0c1 tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "cinder-cf005c20-0dc0-423b-ad95-d081cdca8fce-delete_snapshot" released by "delete_snapshot" :: held 3.340s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:18 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924" returned: 0 in 0.629s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.271s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-349759848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6aaf152-0edd-45f5-8a10-a8da42392cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e196bb5afb49099f83303867deaafc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:09Z,use_quota=True,user_id='59b9e5cb9b5b43c5aa2279ae59d32550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Creating volume c6aaf152-0edd-45f5-8a10-a8da42392cce {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:36:18 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c6aaf152-0edd-45f5-8a10-a8da42392cce 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44fab27-9030-45cc-9bdb-8ab799529292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:18 devstack sudo[108518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c6aaf152-0edd-45f5-8a10-a8da42392cce 1073741824
Apr 29 10:36:18 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f3569f-41f3-4a7e-9feb-9d1a65256540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:18 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Volume volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924 (a35a2b8b-fd2c-45f9-ab95-11c540aec924): created successfully
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f3569f-41f3-4a7e-9feb-9d1a65256540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Flow 'volume_create_manager' (d44f6568-aee8-4f9d-b0a0-1e40b37b4be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:18 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-f4a45d5f-9b13-4ca5-8dd2-1df54de11b78 tempest-CreateVolumesFromImageTest-607934403 None] Created volume successfully.
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Acquiring lock "cinder-1dd18954-7b65-4e5b-af8a-5a319503629e-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "cinder-1dd18954-7b65-4e5b-af8a-5a319503629e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Acquiring lock "cinder-quobyte-1dd18954-7b65-4e5b-af8a-5a319503629e" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "cinder-quobyte-1dd18954-7b65-4e5b-af8a-5a319503629e" acquired by "delete_volume" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:19 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c031b0b-0bff-496b-9cce-281604dac4b1]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:19 devstack sudo[108523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e
Apr 29 10:36:19 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:19 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c6aaf152-0edd-45f5-8a10-a8da42392cce 1073741824" returned: 0 in 0.920s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c6aaf152-0edd-45f5-8a10-a8da42392cce {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:19 devstack sudo[108525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c6aaf152-0edd-45f5-8a10-a8da42392cce
Apr 29 10:36:19 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:19 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e" returned: 0 in 0.804s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:19 devstack sudo[108537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e
Apr 29 10:36:19 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:19 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c6aaf152-0edd-45f5-8a10-a8da42392cce" returned: 0 in 0.643s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:36:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b713c2-bff0-4fab-a77f-305123a1c470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6aaf152-0edd-45f5-8a10-a8da42392cce', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7ff81a-42b6-4cd5-8235-d784c9299fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:19 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Volume volume-c6aaf152-0edd-45f5-8a10-a8da42392cce (c6aaf152-0edd-45f5-8a10-a8da42392cce): created successfully
Apr 29 10:36:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7ff81a-42b6-4cd5-8235-d784c9299fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Flow 'volume_create_manager' (540345ca-ae38-4984-a7a7-e7bbb0a00deb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:19 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-da85a5bf-79bf-443d-84c6-053de73660d5 tempest-CreateVolumesFromImageTest-607934403 None] Created volume successfully.
Apr 29 10:36:20 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-1dd18954-7b65-4e5b-af8a-5a319503629e" returned: 0 in 0.587s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:20 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "cinder-quobyte-1dd18954-7b65-4e5b-af8a-5a319503629e" released by "delete_volume" :: held 1.458s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:20 devstack cinder-volume[84165]: DEBUG cinder.quota [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Created reservations ['567b5efb-1320-4e7d-9f9c-e1c114ae0ef5', '416182fc-7d40-4223-8fa6-2840409bd391', 'd065b053-cd79-402f-8dc2-c356e798f1a2', 'bd3efb5a-c5d0-480c-9ee0-3e021917c28a'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:36:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:20 devstack sudo[108540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:36:20 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "cinder-c6aaf152-0edd-45f5-8a10-a8da42392cce-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-c6aaf152-0edd-45f5-8a10-a8da42392cce-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "cinder-quobyte-c6aaf152-0edd-45f5-8a10-a8da42392cce" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:21 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.622s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:21 devstack cinder-volume[84165]: DEBUG cinder.manager [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:36:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-quobyte-c6aaf152-0edd-45f5-8a10-a8da42392cce" acquired by "delete_volume" :: waited 0.031s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:21 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Deleted volume successfully.
Apr 29 10:36:21 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[225a0d68-1677-4cca-b40b-e6397bcbcd51]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c6aaf152-0edd-45f5-8a10-a8da42392cce {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:21 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-c267429a-a9f1-47e9-b090-183c70b19cff req-86f96419-185c-4cf1-ab61-85b333becc9a tempest-VolumesSnapshotsTestJSON-1559500654 None] Lock "cinder-1dd18954-7b65-4e5b-af8a-5a319503629e-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:21 devstack sudo[108543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c6aaf152-0edd-45f5-8a10-a8da42392cce
Apr 29 10:36:21 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:21 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c6aaf152-0edd-45f5-8a10-a8da42392cce" returned: 0 in 0.774s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c6aaf152-0edd-45f5-8a10-a8da42392cce {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:21 devstack sudo[108551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c6aaf152-0edd-45f5-8a10-a8da42392cce
Apr 29 10:36:21 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:22 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c6aaf152-0edd-45f5-8a10-a8da42392cce" returned: 0 in 0.626s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:22 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-quobyte-c6aaf152-0edd-45f5-8a10-a8da42392cce" released by "delete_volume" :: held 1.457s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:22 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Created reservations ['791c0b60-cece-4741-ac89-cd4632f9df55', '38f07f35-d8c6-4b03-91df-aa569c36746e', '798d5492-ee5e-4faf-8d9f-4795833f6aed', '9cdea976-98c2-44c4-990d-7f6f638c5a5a'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:36:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:22 devstack sudo[108557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:36:22 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "cinder-a35a2b8b-fd2c-45f9-ab95-11c540aec924-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-a35a2b8b-fd2c-45f9-ab95-11c540aec924-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "cinder-quobyte-a35a2b8b-fd2c-45f9-ab95-11c540aec924" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-quobyte-a35a2b8b-fd2c-45f9-ab95-11c540aec924" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:23 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f399a81-af60-4141-84cb-23b4113c6fcc]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:23 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.701s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:23 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:36:23 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Deleted volume successfully.
Apr 29 10:36:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-653af9a1-cd03-4568-a0d8-62da429a7ed3 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-c6aaf152-0edd-45f5-8a10-a8da42392cce-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:23 devstack sudo[108560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924
Apr 29 10:36:23 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:24 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924" returned: 0 in 0.768s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:24 devstack sudo[108568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924
Apr 29 10:36:24 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:24 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a35a2b8b-fd2c-45f9-ab95-11c540aec924" returned: 0 in 0.611s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-quobyte-a35a2b8b-fd2c-45f9-ab95-11c540aec924" released by "delete_volume" :: held 1.428s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:24 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Created reservations ['1ed2628b-579f-4222-a9e8-7d2e2b437962', '45020d6d-5082-4ee0-876a-68f9cb24effa', 'a2d6c64e-0a5f-4c04-9ec5-68e9ba0fa702', '196400e6-be91-4af7-9ebc-36ea8a3d6e48'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:36:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:24 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:24 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:24 devstack sudo[108572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:36:24 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "cinder-49b0136b-1dce-4c46-96bd-64d863204045-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-49b0136b-1dce-4c46-96bd-64d863204045-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "cinder-quobyte-49b0136b-1dce-4c46-96bd-64d863204045" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-quobyte-49b0136b-1dce-4c46-96bd-64d863204045" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:25 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9c464a-3a6a-42be-9eda-3ef5db4467f6]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-49b0136b-1dce-4c46-96bd-64d863204045 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:25 devstack sudo[108622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-49b0136b-1dce-4c46-96bd-64d863204045
Apr 29 10:36:25 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:25 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.929s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:25 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:36:25 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Deleted volume successfully.
Apr 29 10:36:25 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a1e237cc-4426-4e3e-baa8-653d23df58fc tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-a35a2b8b-fd2c-45f9-ab95-11c540aec924-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:26 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-49b0136b-1dce-4c46-96bd-64d863204045" returned: 0 in 0.801s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-49b0136b-1dce-4c46-96bd-64d863204045 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:26 devstack sudo[108629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-49b0136b-1dce-4c46-96bd-64d863204045
Apr 29 10:36:26 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:27 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-49b0136b-1dce-4c46-96bd-64d863204045" returned: 0 in 0.624s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-quobyte-49b0136b-1dce-4c46-96bd-64d863204045" released by "delete_volume" :: held 1.482s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Created reservations ['2481c13e-2d2d-4d69-9999-3c7c11b2c23c', 'e9e8f460-2fde-4d00-811e-886568649418', 'af0f1a44-58c5-4388-974a-804606b84999', 'b99dfdfc-c964-432a-a52c-095e435c264d'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:27 devstack sudo[108634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:36:27 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:27 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.590s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:36:27 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Deleted volume successfully.
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8a6b1a70-d596-4922-9c8f-5769388ccbc1 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-49b0136b-1dce-4c46-96bd-64d863204045-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "cinder-a5786f60-4ed1-41b9-9479-53e620d647e1-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-a5786f60-4ed1-41b9-9479-53e620d647e1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "cinder-quobyte-a5786f60-4ed1-41b9-9479-53e620d647e1" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-quobyte-a5786f60-4ed1-41b9-9479-53e620d647e1" acquired by "delete_volume" :: waited 0.013s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b442e15a-9780-4c22-8aa1-b3f3b65dd06b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a5786f60-4ed1-41b9-9479-53e620d647e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:28 devstack sudo[108637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a5786f60-4ed1-41b9-9479-53e620d647e1
Apr 29 10:36:28 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:28 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a5786f60-4ed1-41b9-9479-53e620d647e1" returned: 0 in 0.721s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a5786f60-4ed1-41b9-9479-53e620d647e1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:28 devstack sudo[108642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a5786f60-4ed1-41b9-9479-53e620d647e1
Apr 29 10:36:28 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:29 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-a5786f60-4ed1-41b9-9479-53e620d647e1" returned: 0 in 0.615s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-quobyte-a5786f60-4ed1-41b9-9479-53e620d647e1" released by "delete_volume" :: held 1.380s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:29 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Created reservations ['06d125cd-f6cd-425b-84f9-ba9fa130fde5', 'f1667bc2-a15c-4569-91ed-d10fbb20a432', 'fe622873-e35f-4428-8049-9fe8551fc0ce', 'e41c74c9-6e87-4b3c-bb87-abeea7dfcc49'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:36:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:29 devstack sudo[108645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:36:29 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:30 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.616s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:30 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:36:30 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Deleted volume successfully.
Apr 29 10:36:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c860a970-4532-46b2-b8f8-f768e6019631 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-a5786f60-4ed1-41b9-9479-53e620d647e1-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "cinder-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "cinder-quobyte-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-quobyte-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:30 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80e6f7f-190d-4bab-9bb6-fe9c843d4ce4]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:30 devstack sudo[108648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa
Apr 29 10:36:30 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:31 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa" returned: 0 in 0.838s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:31 devstack sudo[108653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa
Apr 29 10:36:31 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:31 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa" returned: 0 in 0.697s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-quobyte-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa" released by "delete_volume" :: held 1.581s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:31 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Created reservations ['b2dc19a7-dcfb-45b6-a840-4116beef0e4c', 'aa38ee2e-feb5-40a1-9687-2c824c2cfb9d', '17b55788-53fd-468e-a22a-50594f73964f', 'ba789a89-3952-4b2a-abd2-6800c96c0e6c'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:36:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:31 devstack sudo[108657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:36:31 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:32 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.648s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:32 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:36:32 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Deleted volume successfully.
Apr 29 10:36:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-9b6dc7aa-32b7-43e9-8ece-820059812886 tempest-CreateVolumesFromImageTest-607934403 None] Lock "cinder-7858ea0b-a3f1-4382-80c3-27b6d42aa7fa-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Flow 'volume_create_manager' (0b693f62-7657-4863-a2af-77b5dfe38069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a15b2a-4e44-4627-8b31-1a00756521a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a15b2a-4e44-4627-8b31-1a00756521a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1342899953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18628010-4c35-483d-b211-428c2766111b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7b9ae6458842bbb4ac4effad63cc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:36Z,use_quota=True,user_id='8ac3497a46be486d9ccf0df5a43ca469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf7adfa-e647-4c31-9d85-2fb3d8681819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf7adfa-e647-4c31-9d85-2fb3d8681819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d18eff-077c-437c-8431-ab9294ea2126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d18eff-077c-437c-8431-ab9294ea2126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18628010-4c35-483d-b211-428c2766111b', 'volume_name': 'volume-18628010-4c35-483d-b211-428c2766111b', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea05b106-d03a-4f0b-90c2-fdf03fe92cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea05b106-d03a-4f0b-90c2-fdf03fe92cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cceb63-7190-4ea2-9446-395f6be91ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:35 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume 18628010-4c35-483d-b211-428c2766111b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18628010-4c35-483d-b211-428c2766111b', 'volume_size': 1}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1342899953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18628010-4c35-483d-b211-428c2766111b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7b9ae6458842bbb4ac4effad63cc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:36Z,use_quota=True,user_id='8ac3497a46be486d9ccf0df5a43ca469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Creating volume 18628010-4c35-483d-b211-428c2766111b {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:36:35 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:36:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-18628010-4c35-483d-b211-428c2766111b 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:35 devstack sudo[108665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-18628010-4c35-483d-b211-428c2766111b 1073741824
Apr 29 10:36:35 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:36 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-18628010-4c35-483d-b211-428c2766111b 1073741824" returned: 0 in 0.907s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-18628010-4c35-483d-b211-428c2766111b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:36 devstack sudo[108672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-18628010-4c35-483d-b211-428c2766111b
Apr 29 10:36:36 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:37 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-18628010-4c35-483d-b211-428c2766111b" returned: 0 in 0.721s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:36:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cceb63-7190-4ea2-9446-395f6be91ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18628010-4c35-483d-b211-428c2766111b', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc857642-2460-441e-9c2d-c9bf5b1b9c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:37 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume volume-18628010-4c35-483d-b211-428c2766111b (18628010-4c35-483d-b211-428c2766111b): created successfully
Apr 29 10:36:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc857642-2460-441e-9c2d-c9bf5b1b9c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Flow 'volume_create_manager' (0b693f62-7657-4863-a2af-77b5dfe38069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:37 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-fef2c9a7-5d20-44b4-890c-e9b2327e7bb3 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Created volume successfully.
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-fcc71c22-f5c4-4b6e-85fd-938be1aecd23 req-bafdceff-1e77-458d-aa3d-50c7371dd7c8 tempest-TestStampPattern-2086329137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-fcc71c22-f5c4-4b6e-85fd-938be1aecd23 req-bafdceff-1e77-458d-aa3d-50c7371dd7c8 tempest-TestStampPattern-2086329137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28a883e-35e3-42fe-aa6f-b02dd540fbfd]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-fcc71c22-f5c4-4b6e-85fd-938be1aecd23 req-bafdceff-1e77-458d-aa3d-50c7371dd7c8 tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Flow 'volume_create_manager' (6d5f2b8d-2040-4157-a76b-b849c018ccd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8733e8b-66ef-471a-a1f1-10420f0b72f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:38 devstack sudo[108683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90
Apr 29 10:36:38 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8733e8b-66ef-471a-a1f1-10420f0b72f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2144555863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c328832-21d6-4e0d-8c06-1ff2fabad26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7b9ae6458842bbb4ac4effad63cc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:38Z,use_quota=True,user_id='8ac3497a46be486d9ccf0df5a43ca469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e407404-1734-4c38-bda4-bfe0656a2057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e407404-1734-4c38-bda4-bfe0656a2057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6dda47-5d62-4a58-9db1-1a1c5cfe7c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6dda47-5d62-4a58-9db1-1a1c5cfe7c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c328832-21d6-4e0d-8c06-1ff2fabad26d', 'volume_name': 'volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73d7b35-6959-4e02-8aa0-65c2b4aaac6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73d7b35-6959-4e02-8aa0-65c2b4aaac6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948941e1-4247-43ed-8244-13f388e1a25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:38 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume 0c328832-21d6-4e0d-8c06-1ff2fabad26d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d', 'volume_size': 1}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Flow 'volume_create_manager' (04ffd33a-576d-4f3f-96cf-b42378e0db6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe9af90-29e9-4f2b-931c-c011223a3710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe9af90-29e9-4f2b-931c-c011223a3710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-597323154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e78b78ce-0cdc-40c4-98ac-4629bf3a6862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7b9ae6458842bbb4ac4effad63cc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:39Z,use_quota=True,user_id='8ac3497a46be486d9ccf0df5a43ca469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b764e8e-f36e-4b8f-8fc1-882da044922d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b764e8e-f36e-4b8f-8fc1-882da044922d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09df9df-18aa-4e2f-b4bd-195700bee348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09df9df-18aa-4e2f-b4bd-195700bee348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e78b78ce-0cdc-40c4-98ac-4629bf3a6862', 'volume_name': 'volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5edb6141-c00e-4039-b9ae-2f4f762d8feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5edb6141-c00e-4039-b9ae-2f4f762d8feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f31d11-8a0d-45de-9e7c-9bfc78c4c990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:38 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume e78b78ce-0cdc-40c4-98ac-4629bf3a6862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862', 'volume_size': 1}
Apr 29 10:36:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Flow 'volume_create_manager' (a5c347dc-a230-495f-b898-b54e5d0aebdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e331774-75e7-4b81-8ab4-913ea53d64cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e331774-75e7-4b81-8ab4-913ea53d64cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1056984927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ea30f0-2931-457c-be4c-962e5baaab85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7b9ae6458842bbb4ac4effad63cc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:39Z,use_quota=True,user_id='8ac3497a46be486d9ccf0df5a43ca469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d5bdff-e092-42b8-ba16-f585b4603ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d5bdff-e092-42b8-ba16-f585b4603ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37ea99f-17c9-4633-a31b-2ad80b9be7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37ea99f-17c9-4633-a31b-2ad80b9be7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ea30f0-2931-457c-be4c-962e5baaab85', 'volume_name': 'volume-e7ea30f0-2931-457c-be4c-962e5baaab85', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96b0c35-e4c6-4d93-be08-572a87c358be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96b0c35-e4c6-4d93-be08-572a87c358be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8e7956-37fa-4e3f-bb13-50f7ecd335d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:39 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume e7ea30f0-2931-457c-be4c-962e5baaab85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ea30f0-2931-457c-be4c-962e5baaab85', 'volume_size': 1}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:39 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-fcc71c22-f5c4-4b6e-85fd-938be1aecd23 req-bafdceff-1e77-458d-aa3d-50c7371dd7c8 tempest-TestStampPattern-2086329137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90" returned: 0 in 1.023s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-fcc71c22-f5c4-4b6e-85fd-938be1aecd23 req-bafdceff-1e77-458d-aa3d-50c7371dd7c8 tempest-TestStampPattern-2086329137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.053s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.820s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2144555863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c328832-21d6-4e0d-8c06-1ff2fabad26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7b9ae6458842bbb4ac4effad63cc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:38Z,use_quota=True,user_id='8ac3497a46be486d9ccf0df5a43ca469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Creating volume 0c328832-21d6-4e0d-8c06-1ff2fabad26d {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:36:39 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:39 devstack sudo[108688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d 1073741824
Apr 29 10:36:39 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-fcc71c22-f5c4-4b6e-85fd-938be1aecd23 req-bafdceff-1e77-458d-aa3d-50c7371dd7c8 tempest-TestStampPattern-2086329137 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75be32de-5d88-4ad6-8b6a-032e838f4ec3', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:36:39 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-fcc71c22-f5c4-4b6e-85fd-938be1aecd23 req-bafdceff-1e77-458d-aa3d-50c7371dd7c8 tempest-TestStampPattern-2086329137 None] attachment_update completed successfully.
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Flow 'volume_create_manager' (bcffb2cf-c668-4376-8172-4d5e489e2a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14587ec5-c08a-4291-80cd-2d7c5fb1d610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14587ec5-c08a-4291-80cd-2d7c5fb1d610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-542323312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d76895-6a7b-467b-a6c7-6114c33e18ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7b9ae6458842bbb4ac4effad63cc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:39Z,use_quota=True,user_id='8ac3497a46be486d9ccf0df5a43ca469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219e66b3-6858-4a33-8fb8-aaf3598b8253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219e66b3-6858-4a33-8fb8-aaf3598b8253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39485e7-1efc-412b-a5a9-92c861cc5840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39485e7-1efc-412b-a5a9-92c861cc5840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1d76895-6a7b-467b-a6c7-6114c33e18ec', 'volume_name': 'volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8c3416-c891-41cf-adc3-67865c198e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8c3416-c891-41cf-adc3-67865c198e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645c8204-1137-443c-a26a-efa6ae013271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:39 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume f1d76895-6a7b-467b-a6c7-6114c33e18ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec', 'volume_size': 1}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Flow 'volume_create_manager' (11adee8c-ae83-4354-bd8a-966a5803a533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc096acd-1ce1-46f8-b751-bc263c9098f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc096acd-1ce1-46f8-b751-bc263c9098f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-163455058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7bc149-c9e9-4277-94ea-71cdcc3f07ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7b9ae6458842bbb4ac4effad63cc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:40Z,use_quota=True,user_id='8ac3497a46be486d9ccf0df5a43ca469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7de4511-aaa2-4039-b818-f3b40c919921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7de4511-aaa2-4039-b818-f3b40c919921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c1c21b-c148-4bec-9be2-ee6511637c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c1c21b-c148-4bec-9be2-ee6511637c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b7bc149-c9e9-4277-94ea-71cdcc3f07ea', 'volume_name': 'volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26c774b-f320-49b9-9c23-52de372e5ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26c774b-f320-49b9-9c23-52de372e5ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dcb2462-4b37-4140-8ac1-e573fafeb74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:40 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume 6b7bc149-c9e9-4277-94ea-71cdcc3f07ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea', 'volume_size': 1}
Apr 29 10:36:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:40 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d 1073741824" returned: 0 in 1.035s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:40 devstack sudo[108761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d
Apr 29 10:36:40 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:41 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d" returned: 0 in 0.681s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.263s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-597323154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e78b78ce-0cdc-40c4-98ac-4629bf3a6862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7b9ae6458842bbb4ac4effad63cc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:39Z,use_quota=True,user_id='8ac3497a46be486d9ccf0df5a43ca469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Creating volume e78b78ce-0cdc-40c4-98ac-4629bf3a6862 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:36:41 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:41 devstack sudo[109080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862 1073741824
Apr 29 10:36:41 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948941e1-4247-43ed-8244-13f388e1a25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f243b6a-760c-4d23-b3a3-a3e107c8d76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:41 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d (0c328832-21d6-4e0d-8c06-1ff2fabad26d): created successfully
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f243b6a-760c-4d23-b3a3-a3e107c8d76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Flow 'volume_create_manager' (6d5f2b8d-2040-4157-a76b-b849c018ccd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:41 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5006e392-b98b-4b7b-b2b6-6c728325fa6e tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Created volume successfully.
Apr 29 10:36:41 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862 1073741824" returned: 0 in 0.906s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:42 devstack sudo[109086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862
Apr 29 10:36:42 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:42 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862" returned: 0 in 0.655s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.507s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1056984927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ea30f0-2931-457c-be4c-962e5baaab85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7b9ae6458842bbb4ac4effad63cc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:39Z,use_quota=True,user_id='8ac3497a46be486d9ccf0df5a43ca469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Creating volume e7ea30f0-2931-457c-be4c-962e5baaab85 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:36:42 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e7ea30f0-2931-457c-be4c-962e5baaab85 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f31d11-8a0d-45de-9e7c-9bfc78c4c990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:42 devstack sudo[109089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e7ea30f0-2931-457c-be4c-962e5baaab85 1073741824
Apr 29 10:36:42 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bc7cfc-c722-49ba-b617-877cdfb92060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:42 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862 (e78b78ce-0cdc-40c4-98ac-4629bf3a6862): created successfully
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bc7cfc-c722-49ba-b617-877cdfb92060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:42 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Flow 'volume_create_manager' (04ffd33a-576d-4f3f-96cf-b42378e0db6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:42 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e3f11763-3a30-4b1f-8c73-6b1bc2cda862 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Created volume successfully.
Apr 29 10:36:43 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e7ea30f0-2931-457c-be4c-962e5baaab85 1073741824" returned: 0 in 0.956s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e7ea30f0-2931-457c-be4c-962e5baaab85 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:43 devstack sudo[109094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e7ea30f0-2931-457c-be4c-962e5baaab85
Apr 29 10:36:43 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:44 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e7ea30f0-2931-457c-be4c-962e5baaab85" returned: 0 in 0.613s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.640s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-542323312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d76895-6a7b-467b-a6c7-6114c33e18ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7b9ae6458842bbb4ac4effad63cc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:39Z,use_quota=True,user_id='8ac3497a46be486d9ccf0df5a43ca469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Creating volume f1d76895-6a7b-467b-a6c7-6114c33e18ec {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:36:44 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8e7956-37fa-4e3f-bb13-50f7ecd335d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ea30f0-2931-457c-be4c-962e5baaab85', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:44 devstack sudo[109098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec 1073741824
Apr 29 10:36:44 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c24e243-6ec2-4688-9cd1-278d75803888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:44 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume volume-e7ea30f0-2931-457c-be4c-962e5baaab85 (e7ea30f0-2931-457c-be4c-962e5baaab85): created successfully
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c24e243-6ec2-4688-9cd1-278d75803888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Flow 'volume_create_manager' (a5c347dc-a230-495f-b898-b54e5d0aebdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:44 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d074f2e5-53af-41a3-8413-6136979e3fe5 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Created volume successfully.
Apr 29 10:36:45 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec 1073741824" returned: 0 in 0.917s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:45 devstack sudo[109119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec
Apr 29 10:36:45 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:46 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec" returned: 0 in 0.760s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.977s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-163455058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7bc149-c9e9-4277-94ea-71cdcc3f07ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7b9ae6458842bbb4ac4effad63cc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:40Z,use_quota=True,user_id='8ac3497a46be486d9ccf0df5a43ca469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Creating volume 6b7bc149-c9e9-4277-94ea-71cdcc3f07ea {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:36:46 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645c8204-1137-443c-a26a-efa6ae013271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:46 devstack sudo[109122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea 1073741824
Apr 29 10:36:46 devstack sudo[109122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0ed1e7-2851-4351-aa1a-69dfc2eb8a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:46 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec (f1d76895-6a7b-467b-a6c7-6114c33e18ec): created successfully
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0ed1e7-2851-4351-aa1a-69dfc2eb8a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Flow 'volume_create_manager' (bcffb2cf-c668-4376-8172-4d5e489e2a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:46 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c1a6b4ce-abdc-4e98-ba42-c51add8c4240 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Created volume successfully.
Apr 29 10:36:46 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Flow 'volume_create_manager' (64ee5137-eebe-4f77-b423-3b29defa458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd902b8c-1a1c-4fb5-bafd-49531fbdc8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd902b8c-1a1c-4fb5-bafd-49531fbdc8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-245968076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8caaa43e-cd21-4976-a94c-5d3f71e68de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e88ada50ec4442810e23cb5b55d5d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:47Z,use_quota=True,user_id='0827da7f108e4bf0b24cecd3d7659ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6732fc-785e-45c3-87da-6fe9fba94e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:47 devstack sudo[109122]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6732fc-785e-45c3-87da-6fe9fba94e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96f2764-c7d1-4b56-a8fd-9fc576282c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96f2764-c7d1-4b56-a8fd-9fc576282c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8caaa43e-cd21-4976-a94c-5d3f71e68de2', 'volume_name': 'volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719eb87f-0c8b-4bdf-8758-6478c0889e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719eb87f-0c8b-4bdf-8758-6478c0889e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8019ef5c-f74a-41f4-9ef5-ef29b25b98e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:47 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Volume 8caaa43e-cd21-4976-a94c-5d3f71e68de2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2', 'volume_size': 1}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea 1073741824" returned: 0 in 1.082s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:47 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-ec219ab5-ea6a-4115-ac22-b1d74f1adbed req-0ed90cd6-040a-4621-b4c1-b8c83aff37b6 tempest-TestStampPattern-2086329137 None] Terminate volume connection completed successfully.
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-ec219ab5-ea6a-4115-ac22-b1d74f1adbed req-0ed90cd6-040a-4621-b4c1-b8c83aff37b6 tempest-TestStampPattern-2086329137 None] Deleting attachment 75be32de-5d88-4ad6-8b6a-032e838f4ec3. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:47 devstack sudo[109156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea
Apr 29 10:36:47 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:47 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea" returned: 0 in 0.620s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.683s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-245968076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8caaa43e-cd21-4976-a94c-5d3f71e68de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e88ada50ec4442810e23cb5b55d5d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:47Z,use_quota=True,user_id='0827da7f108e4bf0b24cecd3d7659ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Creating volume 8caaa43e-cd21-4976-a94c-5d3f71e68de2 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:36:47 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dcb2462-4b37-4140-8ac1-e573fafeb74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:47 devstack sudo[109159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2 1073741824
Apr 29 10:36:47 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598513b8-414b-4394-8137-dc68a0bf0e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:47 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Volume volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea (6b7bc149-c9e9-4277-94ea-71cdcc3f07ea): created successfully
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598513b8-414b-4394-8137-dc68a0bf0e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Flow 'volume_create_manager' (11adee8c-ae83-4354-bd8a-966a5803a533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:47 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-dba28b90-33ee-4710-aa18-0150cb5e65fb tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Created volume successfully.
Apr 29 10:36:48 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2 1073741824" returned: 0 in 0.869s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "cinder-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:48 devstack sudo[109164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2
Apr 29 10:36:48 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "cinder-quobyte-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-quobyte-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:48 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2da34ea-35e6-4e11-abb5-4a998a8a6778]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:48 devstack sudo[109166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea
Apr 29 10:36:48 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:49 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2" returned: 0 in 0.647s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:36:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8019ef5c-f74a-41f4-9ef5-ef29b25b98e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a6e2ff-56db-4f69-85a5-f74d102c06fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:49 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Volume volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2 (8caaa43e-cd21-4976-a94c-5d3f71e68de2): created successfully
Apr 29 10:36:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a6e2ff-56db-4f69-85a5-f74d102c06fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Flow 'volume_create_manager' (64ee5137-eebe-4f77-b423-3b29defa458c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:49 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8a6e45e0-a09d-4014-bbcd-7d70089123fd tempest-VolumesServicesTestJSON-1428986267 None] Created volume successfully.
Apr 29 10:36:49 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea" returned: 0 in 0.796s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:49 devstack sudo[109174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea
Apr 29 10:36:49 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:50 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Acquiring lock "cinder-8caaa43e-cd21-4976-a94c-5d3f71e68de2-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:50 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:50 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Lock "cinder-8caaa43e-cd21-4976-a94c-5d3f71e68de2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea" returned: 0 in 0.707s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:50 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-quobyte-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea" released by "delete_volume" :: held 1.559s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:50 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Acquiring lock "cinder-quobyte-8caaa43e-cd21-4976-a94c-5d3f71e68de2" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:50 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Lock "cinder-quobyte-8caaa43e-cd21-4976-a94c-5d3f71e68de2" acquired by "delete_volume" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:50 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f026c080-0ef5-4bd9-b3a7-cf29c3a155d6]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:50 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Created reservations ['fe3e1168-7b90-48dd-b32f-04a802961c92', '0c7371c7-5109-430e-8576-3af89bc0ac22', '5a53b758-a20b-41a3-8ac0-78081ce500dd', '0e7d75b0-25ce-458a-9e62-9ee10e497d6f'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:36:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:50 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:50 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:50 devstack sudo[109178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:36:50 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:50 devstack sudo[109177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2
Apr 29 10:36:50 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "cinder-f1d76895-6a7b-467b-a6c7-6114c33e18ec-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-f1d76895-6a7b-467b-a6c7-6114c33e18ec-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "cinder-quobyte-f1d76895-6a7b-467b-a6c7-6114c33e18ec" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-quobyte-f1d76895-6a7b-467b-a6c7-6114c33e18ec" acquired by "delete_volume" :: waited 0.029s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:51 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9721edf4-f010-42f9-b025-6b7bc303c927]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:51 devstack sudo[109212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec
Apr 29 10:36:51 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:51 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.074s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:51 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:36:51 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Deleted volume successfully.
Apr 29 10:36:51 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2" returned: 0 in 1.203s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dfd2e237-3d93-4088-8ae5-392df4950b38 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-6b7bc149-c9e9-4277-94ea-71cdcc3f07ea-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:51 devstack sudo[109220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2
Apr 29 10:36:51 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:52 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec" returned: 0 in 0.919s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:52 devstack sudo[109226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec
Apr 29 10:36:52 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:52 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8caaa43e-cd21-4976-a94c-5d3f71e68de2" returned: 0 in 0.627s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Lock "cinder-quobyte-8caaa43e-cd21-4976-a94c-5d3f71e68de2" released by "delete_volume" :: held 1.884s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:52 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Created reservations ['35a3a496-3535-401c-80f0-d5df6677bb50', '2321e5b0-8eb3-41a9-a26c-ae968e7e08a4', '62ca0844-1f23-4644-b4e7-bf19c9428edf', 'a7b76471-d221-41e6-849f-dd800c7f0abb'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:36:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:52 devstack sudo[109228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:36:52 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:52 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1d76895-6a7b-467b-a6c7-6114c33e18ec" returned: 0 in 0.730s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-quobyte-f1d76895-6a7b-467b-a6c7-6114c33e18ec" released by "delete_volume" :: held 1.724s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Created reservations ['ff9a3626-1cd2-4a89-b893-52c04fe8768e', '0d6196d3-480e-45dd-b814-d5a70da2ea41', 'cecb77dc-955b-4f8b-bafa-b4c090e80275', 'a6d7c4d0-c324-4530-83ca-8e9a650eeeac'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:53 devstack sudo[109233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:36:53 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:53 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.762s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:36:53 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Deleted volume successfully.
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c81c3957-d0a9-40d3-b260-e5938d70ed20 tempest-VolumesServicesTestJSON-1428986267 None] Lock "cinder-8caaa43e-cd21-4976-a94c-5d3f71e68de2-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "cinder-e7ea30f0-2931-457c-be4c-962e5baaab85-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-e7ea30f0-2931-457c-be4c-962e5baaab85-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "cinder-quobyte-e7ea30f0-2931-457c-be4c-962e5baaab85" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-quobyte-e7ea30f0-2931-457c-be4c-962e5baaab85" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a51b19-8fbe-4cae-a546-6e236b6806b5]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e7ea30f0-2931-457c-be4c-962e5baaab85 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:53 devstack sudo[109235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e7ea30f0-2931-457c-be4c-962e5baaab85
Apr 29 10:36:53 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:53 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.753s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:36:53 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Deleted volume successfully.
Apr 29 10:36:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-40bd327f-c141-4fae-9a80-60703e9233d8 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-f1d76895-6a7b-467b-a6c7-6114c33e18ec-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:54 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e7ea30f0-2931-457c-be4c-962e5baaab85" returned: 0 in 0.831s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e7ea30f0-2931-457c-be4c-962e5baaab85 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:54 devstack sudo[109242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e7ea30f0-2931-457c-be4c-962e5baaab85
Apr 29 10:36:54 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:55 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e7ea30f0-2931-457c-be4c-962e5baaab85" returned: 0 in 0.660s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-quobyte-e7ea30f0-2931-457c-be4c-962e5baaab85" released by "delete_volume" :: held 1.541s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Created reservations ['66fb88c1-d70c-4859-9f27-1517f34b2335', 'ea2248c2-b56c-4fe7-b092-1c14beafd51f', '8a2557c1-e30a-4c99-ab6d-ced5b4809613', '7fcf22be-5f3c-4ee1-894f-3ec8cd9280ba'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:55 devstack sudo[109245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:36:55 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "cinder-e78b78ce-0cdc-40c4-98ac-4629bf3a6862-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-e78b78ce-0cdc-40c4-98ac-4629bf3a6862-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "cinder-quobyte-e78b78ce-0cdc-40c4-98ac-4629bf3a6862" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-quobyte-e78b78ce-0cdc-40c4-98ac-4629bf3a6862" acquired by "delete_volume" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6befbf52-ca39-4bba-be41-88b66244e142]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:55 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.716s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:36:55 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Deleted volume successfully.
Apr 29 10:36:55 devstack sudo[109248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862
Apr 29 10:36:55 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-00624d46-7a93-4725-8f38-452933c6d6e4 tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-e7ea30f0-2931-457c-be4c-962e5baaab85-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Acquiring lock "cinder-94d4bfec-96d3-4bf2-9286-63f6a7838f90-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Lock "cinder-94d4bfec-96d3-4bf2-9286-63f6a7838f90-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Acquiring lock "cinder-quobyte-94d4bfec-96d3-4bf2-9286-63f6a7838f90" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Lock "cinder-quobyte-94d4bfec-96d3-4bf2-9286-63f6a7838f90" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:56 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862" returned: 0 in 0.856s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:56 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ded7251-1a7e-4d91-b8aa-3a3e2334b264]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:56 devstack sudo[109253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862
Apr 29 10:36:56 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:56 devstack sudo[109254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90
Apr 29 10:36:56 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:57 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e78b78ce-0cdc-40c4-98ac-4629bf3a6862" returned: 0 in 0.694s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-quobyte-e78b78ce-0cdc-40c4-98ac-4629bf3a6862" released by "delete_volume" :: held 1.602s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:57 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Created reservations ['3636da0b-e0a2-4a06-94c7-45a411641cf6', '3342cc75-7732-429d-ba8e-5a906af86ec2', 'bd036d6c-8f43-4e29-bed3-69fa48128729', '53e0a867-4c07-4064-81f0-f78b25b30d5d'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:36:57 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90" returned: 0 in 0.799s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:57 devstack sudo[109261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90
Apr 29 10:36:57 devstack sudo[109261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:57 devstack sudo[109262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:36:57 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "cinder-0c328832-21d6-4e0d-8c06-1ff2fabad26d-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-0c328832-21d6-4e0d-8c06-1ff2fabad26d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "cinder-quobyte-0c328832-21d6-4e0d-8c06-1ff2fabad26d" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-quobyte-0c328832-21d6-4e0d-8c06-1ff2fabad26d" acquired by "delete_volume" :: waited 0.033s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d1856d-5d18-41cd-b092-bf2706a7684f]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:58 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.663s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:36:58 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Deleted volume successfully.
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-bab3da2c-9550-4e1c-be95-4f232167f8bd tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-e78b78ce-0cdc-40c4-98ac-4629bf3a6862-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:58 devstack sudo[109261]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-94d4bfec-96d3-4bf2-9286-63f6a7838f90" returned: 0 in 0.755s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Lock "cinder-quobyte-94d4bfec-96d3-4bf2-9286-63f6a7838f90" released by "delete_volume" :: held 1.624s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:58 devstack sudo[109267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d
Apr 29 10:36:58 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Created reservations ['c0be219f-f305-4c03-8887-bc3ca3647c1f', 'a19d07fc-7a3b-47ee-8df1-a716b35abedd', 'b07648a4-dd97-4d0b-8dc1-80e97f90a6d6', '8aba3853-576d-494e-8fa1-823e5cf3054d'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:58 devstack sudo[109269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:36:58 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Flow 'volume_create_manager' (86e058b1-79b4-45f8-9f9c-1d9804b3b783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef194a3-110b-46c2-ade9-f91639a7949e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef194a3-110b-46c2-ade9-f91639a7949e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-806685900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb547bae-06e6-4207-a363-02896e58c806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd856609909b442fa058f6703863b56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:59Z,use_quota=True,user_id='9fa184fa12ed46f5a7e8ef0e269942bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616e8bff-3174-4403-a0c1-d9c27f8385a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616e8bff-3174-4403-a0c1-d9c27f8385a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c2a281-0d87-487e-9bd9-52a519fe2a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c2a281-0d87-487e-9bd9-52a519fe2a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb547bae-06e6-4207-a363-02896e58c806', 'volume_name': 'volume-bb547bae-06e6-4207-a363-02896e58c806', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c5007a-3194-4c8c-adab-0bf3ec79eb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c5007a-3194-4c8c-adab-0bf3ec79eb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194d15e2-1af0-4dcb-a98a-1bad6d34cb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:36:58 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Volume bb547bae-06e6-4207-a363-02896e58c806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb547bae-06e6-4207-a363-02896e58c806', 'volume_size': 1}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-806685900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb547bae-06e6-4207-a363-02896e58c806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd856609909b442fa058f6703863b56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:59Z,use_quota=True,user_id='9fa184fa12ed46f5a7e8ef0e269942bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Creating volume bb547bae-06e6-4207-a363-02896e58c806 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:36:58 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:36:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bb547bae-06e6-4207-a363-02896e58c806 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:58 devstack sudo[109271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bb547bae-06e6-4207-a363-02896e58c806 1073741824
Apr 29 10:36:58 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:58 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d" returned: 0 in 0.905s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:59 devstack sudo[109278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d
Apr 29 10:36:59 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:59 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.704s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:36:59 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Deleted volume successfully.
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-2f05b2c0-7703-43b1-85c4-ea63e1a43188 tempest-TestStampPattern-2086329137 None] Lock "cinder-94d4bfec-96d3-4bf2-9286-63f6a7838f90-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Acquiring lock "cinder-834d3baf-5aad-4613-b60d-b04cfdd10337-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Lock "cinder-834d3baf-5aad-4613-b60d-b04cfdd10337-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Acquiring lock "cinder-quobyte-c8f2fa40-108a-452d-9ed1-844c1d5de999" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Lock "cinder-quobyte-c8f2fa40-108a-452d-9ed1-844c1d5de999" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Acquiring lock "cinder-quobyte-834d3baf-5aad-4613-b60d-b04cfdd10337" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Lock "cinder-quobyte-834d3baf-5aad-4613-b60d-b04cfdd10337" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Deleting offline snapshot 834d3baf-5aad-4613-b60d-b04cfdd10337 of volume c8f2fa40-108a-452d-9ed1-844c1d5de999 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] snapshot_file for this snap is: volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f626ad9-11c2-4304-9e89-adb1928bc8a8]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:59 devstack sudo[109280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337
Apr 29 10:36:59 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:59 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-0c328832-21d6-4e0d-8c06-1ff2fabad26d" returned: 0 in 0.718s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:59 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bb547bae-06e6-4207-a363-02896e58c806 1073741824" returned: 0 in 1.065s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-quobyte-0c328832-21d6-4e0d-8c06-1ff2fabad26d" released by "delete_volume" :: held 1.695s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bb547bae-06e6-4207-a363-02896e58c806 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:59 devstack sudo[109287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bb547bae-06e6-4207-a363-02896e58c806
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Created reservations ['8455d37b-bec9-4106-abf7-52c9e8ba8dcf', 'f8f8968a-ac82-431e-8346-68a0085db7fe', '3bdd1afc-16ed-4d29-9359-688e9906d853', '17f8b591-e78c-40f9-b1de-0ee5d36a93a6'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:36:59 devstack sudo[109287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:36:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:36:59 devstack sudo[109289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:36:59 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:00 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337" returned: 0 in 0.801s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8f2fa40-108a-452d-9ed1-844c1d5de999(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4477f6ab-3bb9-418d-9c89-117edbf9b580]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "cinder-18628010-4c35-483d-b211-428c2766111b-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-18628010-4c35-483d-b211-428c2766111b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:00 devstack sudo[109295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999
Apr 29 10:37:00 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "cinder-quobyte-18628010-4c35-483d-b211-428c2766111b" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-quobyte-18628010-4c35-483d-b211-428c2766111b" acquired by "delete_volume" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d646fb-9993-427b-a8fc-b7fe1d0d61e0]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-18628010-4c35-483d-b211-428c2766111b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:00 devstack sudo[109287]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bb547bae-06e6-4207-a363-02896e58c806" returned: 0 in 0.689s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194d15e2-1af0-4dcb-a98a-1bad6d34cb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb547bae-06e6-4207-a363-02896e58c806', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6237d8ce-3dec-4816-9e60-6705a77d9db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:00 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Volume volume-bb547bae-06e6-4207-a363-02896e58c806 (bb547bae-06e6-4207-a363-02896e58c806): created successfully
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6237d8ce-3dec-4816-9e60-6705a77d9db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Flow 'volume_create_manager' (86e058b1-79b4-45f8-9f9c-1d9804b3b783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:37:00 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-881b5d1b-ff95-4248-abb7-382162e131d4 tempest-VolumesListAdminTestJSON-1932606975 None] Created volume successfully.
Apr 29 10:37:00 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:00 devstack sudo[109299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-18628010-4c35-483d-b211-428c2766111b
Apr 29 10:37:00 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.700s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:37:00 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Deleted volume successfully.
Apr 29 10:37:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-477bd6dd-6315-44af-8f91-4142c74b2a1b tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-0c328832-21d6-4e0d-8c06-1ff2fabad26d-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:01 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999" returned: 0 in 0.964s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:01 devstack sudo[109305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337
Apr 29 10:37:01 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Flow 'volume_create_manager' (abea1562-9a2e-47b3-aec0-f32bd16c0c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bb2f2b-9b7e-4ed9-8a10-c5cd66fd2357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bb2f2b-9b7e-4ed9-8a10-c5cd66fd2357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-86442775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dade274-7cff-4030-be98-43d1ac212503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd856609909b442fa058f6703863b56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:01Z,use_quota=True,user_id='9fa184fa12ed46f5a7e8ef0e269942bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d813b0-7313-4de1-94db-cd9e166eb102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d813b0-7313-4de1-94db-cd9e166eb102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:01 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589d6c4a-c4a9-469a-91ce-73f90dd4c6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589d6c4a-c4a9-469a-91ce-73f90dd4c6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dade274-7cff-4030-be98-43d1ac212503', 'volume_name': 'volume-5dade274-7cff-4030-be98-43d1ac212503', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9d0558-cfbb-468c-b56b-1b6248972a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9d0558-cfbb-468c-b56b-1b6248972a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c12d563-46f0-4571-9cfd-214add5fe801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:01 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Volume 5dade274-7cff-4030-be98-43d1ac212503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dade274-7cff-4030-be98-43d1ac212503', 'volume_size': 1}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-86442775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dade274-7cff-4030-be98-43d1ac212503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd856609909b442fa058f6703863b56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:01Z,use_quota=True,user_id='9fa184fa12ed46f5a7e8ef0e269942bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Creating volume 5dade274-7cff-4030-be98-43d1ac212503 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:37:01 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5dade274-7cff-4030-be98-43d1ac212503 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-18628010-4c35-483d-b211-428c2766111b" returned: 0 in 0.900s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-18628010-4c35-483d-b211-428c2766111b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:01 devstack sudo[109310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5dade274-7cff-4030-be98-43d1ac212503 1073741824
Apr 29 10:37:01 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:01 devstack sudo[109311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-18628010-4c35-483d-b211-428c2766111b
Apr 29 10:37:01 devstack sudo[109311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:01 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337" returned: 0 in 0.792s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:01 devstack sudo[109320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337
Apr 29 10:37:01 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:02 devstack sudo[109311]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-18628010-4c35-483d-b211-428c2766111b" returned: 0 in 0.691s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-quobyte-18628010-4c35-483d-b211-428c2766111b" released by "delete_volume" :: held 1.650s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Created reservations ['445b8e31-36dd-40be-8be3-888d68cde32c', '01bf74db-05ad-4e93-b2eb-4857f1e1cf33', 'f05f0119-7a8b-4059-99aa-a15fc9df3b40', '84671ccf-42a0-45ed-8820-1085f99b1a2d'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:02 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5dade274-7cff-4030-be98-43d1ac212503 1073741824" returned: 0 in 0.912s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:02 devstack sudo[109325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:37:02 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5dade274-7cff-4030-be98-43d1ac212503 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:02 devstack sudo[109327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5dade274-7cff-4030-be98-43d1ac212503
Apr 29 10:37:02 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:02 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999.834d3baf-5aad-4613-b60d-b04cfdd10337" returned: 0 in 0.753s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Lock "cinder-quobyte-834d3baf-5aad-4613-b60d-b04cfdd10337" released by "_delete_snapshot" :: held 3.443s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Lock "cinder-quobyte-c8f2fa40-108a-452d-9ed1-844c1d5de999" released by "delete_snapshot" :: held 3.469s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Created reservations ['c9a981ec-20fc-43ec-833d-585d33bff619', 'bb293f94-df9d-4492-a397-409b150cb12a', '9900a4bd-a841-49de-b0da-3d60f9c7aff5', 'e294d74e-dddc-4db3-af7a-9e9accec8e8d'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:37:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Delete snapshot completed successfully.
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-84f54b8d-5acc-458a-a972-892912238aa6 tempest-TestStampPattern-2086329137 None] Lock "cinder-834d3baf-5aad-4613-b60d-b04cfdd10337-delete_snapshot" released by "delete_snapshot" :: held 3.662s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:02 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.677s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:37:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Deleted volume successfully.
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ce8df757-46ab-492f-a39b-fbe72c87291c tempest-CreateVolumesFromSourceVolumeTest-42258329 None] Lock "cinder-18628010-4c35-483d-b211-428c2766111b-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:02 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5dade274-7cff-4030-be98-43d1ac212503" returned: 0 in 0.673s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c12d563-46f0-4571-9cfd-214add5fe801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dade274-7cff-4030-be98-43d1ac212503', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d7d428-ee0e-4f23-a236-ff7740d89260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:03 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Volume volume-5dade274-7cff-4030-be98-43d1ac212503 (5dade274-7cff-4030-be98-43d1ac212503): created successfully
Apr 29 10:37:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d7d428-ee0e-4f23-a236-ff7740d89260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Flow 'volume_create_manager' (abea1562-9a2e-47b3-aec0-f32bd16c0c02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:37:03 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-fbd5bff4-f750-48f9-92ee-3e7a167e8ab1 tempest-VolumesListAdminTestJSON-1932606975 None] Created volume successfully.
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Flow 'volume_create_manager' (928e5141-763f-428a-b737-32751695f167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd617b1b-9398-4bff-b99a-9ad24ffc83dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd617b1b-9398-4bff-b99a-9ad24ffc83dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-957023507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f792dab0-3cc7-44e8-b3cb-9e15bc90312c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd856609909b442fa058f6703863b56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:04Z,use_quota=True,user_id='9fa184fa12ed46f5a7e8ef0e269942bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da94ebe-dee4-4961-903c-7d27482eab6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da94ebe-dee4-4961-903c-7d27482eab6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705f7d72-a671-47bd-9868-8ab599e685ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705f7d72-a671-47bd-9868-8ab599e685ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f792dab0-3cc7-44e8-b3cb-9e15bc90312c', 'volume_name': 'volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d398d7d4-6f6e-4526-83c7-ff5781b92f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d398d7d4-6f6e-4526-83c7-ff5781b92f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f95e37b-cec5-46ac-bed5-dfca6b95f5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:04 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Volume f792dab0-3cc7-44e8-b3cb-9e15bc90312c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c', 'volume_size': 1}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-957023507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f792dab0-3cc7-44e8-b3cb-9e15bc90312c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd856609909b442fa058f6703863b56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:04Z,use_quota=True,user_id='9fa184fa12ed46f5a7e8ef0e269942bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Creating volume f792dab0-3cc7-44e8-b3cb-9e15bc90312c {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:37:04 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:37:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:04 devstack sudo[109333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c 1073741824
Apr 29 10:37:04 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:05 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c 1073741824" returned: 0 in 0.996s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:05 devstack sudo[109341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c
Apr 29 10:37:05 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:37:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:05 devstack sudo[109343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:37:05 devstack sudo[109343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:06 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c" returned: 0 in 0.758s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:37:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f95e37b-cec5-46ac-bed5-dfca6b95f5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56050582-2e3b-4ed7-b29c-4edc16cca564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:06 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Volume volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c (f792dab0-3cc7-44e8-b3cb-9e15bc90312c): created successfully
Apr 29 10:37:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56050582-2e3b-4ed7-b29c-4edc16cca564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Flow 'volume_create_manager' (928e5141-763f-428a-b737-32751695f167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:37:06 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-332c6a7a-4eb6-45b2-a046-3f14aca1c4ae tempest-VolumesListAdminTestJSON-1932606975 None] Created volume successfully.
Apr 29 10:37:06 devstack sudo[109343]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.891s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=119,cinder:UPDATE=167,cinder:DELETE=15,cinder:INSERT=44 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=175,cinder:SELECT=123,cinder:INSERT=36,cinder:DELETE=15 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Flow 'volume_create_manager' (b44fb61d-14e5-4de0-ae63-e4d5ce622609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195b4156-fe4f-440e-8712-064d1178f9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195b4156-fe4f-440e-8712-064d1178f9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e673d93-8e67-4feb-82ac-d154ff9b4f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed7064b27234581a724e173e604eb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:07Z,use_quota=True,user_id='32a1dab247d445ae95ae6efd7a029087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bc6382-7bbb-4773-b618-94384cebfb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bc6382-7bbb-4773-b618-94384cebfb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280ce5be-29d3-449f-bbe3-0dd3c94bd5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280ce5be-29d3-449f-bbe3-0dd3c94bd5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e673d93-8e67-4feb-82ac-d154ff9b4f5b', 'volume_name': 'volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73eac8af-ebb9-4978-a0c6-71bfdd443e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73eac8af-ebb9-4978-a0c6-71bfdd443e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3bbcf69-958c-4053-9f5b-b4c2a0a98757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:07 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Volume 6e673d93-8e67-4feb-82ac-d154ff9b4f5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b', 'volume_size': 1}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e673d93-8e67-4feb-82ac-d154ff9b4f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed7064b27234581a724e173e604eb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:07Z,use_quota=True,user_id='32a1dab247d445ae95ae6efd7a029087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Creating volume 6e673d93-8e67-4feb-82ac-d154ff9b4f5b {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:37:07 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:37:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:07 devstack sudo[109390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b 1073741824
Apr 29 10:37:07 devstack sudo[109390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:08 devstack sudo[109390]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b 1073741824" returned: 0 in 0.816s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:08 devstack sudo[109396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b
Apr 29 10:37:08 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:08 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b" returned: 0 in 0.613s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:37:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3bbcf69-958c-4053-9f5b-b4c2a0a98757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df7c1ea-744a-4774-a444-3ffb6d07817f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:08 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Volume volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b (6e673d93-8e67-4feb-82ac-d154ff9b4f5b): created successfully
Apr 29 10:37:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df7c1ea-744a-4774-a444-3ffb6d07817f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Flow 'volume_create_manager' (b44fb61d-14e5-4de0-ae63-e4d5ce622609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:37:08 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d4646235-5204-4472-98a1-e610c2506226 tempest-VolumesListAdminTestJSON-1135280268 None] Created volume successfully.
Apr 29 10:37:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Acquiring lock "cinder-6e673d93-8e67-4feb-82ac-d154ff9b4f5b-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Lock "cinder-6e673d93-8e67-4feb-82ac-d154ff9b4f5b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Acquiring lock "cinder-quobyte-6e673d93-8e67-4feb-82ac-d154ff9b4f5b" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Lock "cinder-quobyte-6e673d93-8e67-4feb-82ac-d154ff9b4f5b" acquired by "delete_volume" :: waited 0.014s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:09 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[866758a5-b096-4d2a-b853-8727740da05b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Acquiring lock "cinder-f792dab0-3cc7-44e8-b3cb-9e15bc90312c-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Lock "cinder-f792dab0-3cc7-44e8-b3cb-9e15bc90312c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Acquiring lock "cinder-quobyte-f792dab0-3cc7-44e8-b3cb-9e15bc90312c" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:09 devstack sudo[109399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b
Apr 29 10:37:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Lock "cinder-quobyte-f792dab0-3cc7-44e8-b3cb-9e15bc90312c" acquired by "delete_volume" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:09 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:09 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[37807196-9c1f-44f1-b75e-3a4e274b7d6d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:09 devstack sudo[109401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c
Apr 29 10:37:09 devstack sudo[109401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:10 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b" returned: 0 in 0.721s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:10 devstack sudo[109406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b
Apr 29 10:37:10 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:10 devstack sudo[109401]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c" returned: 0 in 0.762s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:10 devstack sudo[109411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c
Apr 29 10:37:10 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:10 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-6e673d93-8e67-4feb-82ac-d154ff9b4f5b" returned: 0 in 0.593s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Lock "cinder-quobyte-6e673d93-8e67-4feb-82ac-d154ff9b4f5b" released by "delete_volume" :: held 1.365s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:10 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Created reservations ['07ccc8fd-9861-4100-bc6d-975e90ae8a27', '0be2bf10-b9bf-47ce-8c25-4fe16a4f80a1', '30d7abf6-c90b-4240-87a5-ad060f3a4711', '7ac79c8c-a68f-4285-88ef-46a6401b3944'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:37:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:10 devstack sudo[109415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:37:10 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:11 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f792dab0-3cc7-44e8-b3cb-9e15bc90312c" returned: 0 in 0.624s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Lock "cinder-quobyte-f792dab0-3cc7-44e8-b3cb-9e15bc90312c" released by "delete_volume" :: held 1.444s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Acquiring lock "cinder-c8f2fa40-108a-452d-9ed1-844c1d5de999-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Created reservations ['a391d297-dd92-4b64-aec8-c4cda931c229', '4ab1d918-a6b5-4b61-bdad-9e81b815d4d7', '9355a43f-06dd-4d0e-88e2-291a77349080', '85788182-2c8e-48b0-9bb0-5e2d803fa3ff'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Lock "cinder-c8f2fa40-108a-452d-9ed1-844c1d5de999-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Acquiring lock "cinder-quobyte-c8f2fa40-108a-452d-9ed1-844c1d5de999" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Lock "cinder-quobyte-c8f2fa40-108a-452d-9ed1-844c1d5de999" acquired by "delete_volume" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc4a213-3c21-44ef-bd62-8e722fc1fec5]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:11 devstack sudo[109418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:37:11 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:11 devstack sudo[109417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999
Apr 29 10:37:11 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:11 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.679s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:37:11 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Deleted volume successfully.
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ba4de061-ab68-49aa-93db-c5fceec2afba tempest-VolumesListAdminTestJSON-1135280268 None] Lock "cinder-6e673d93-8e67-4feb-82ac-d154ff9b4f5b-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Acquiring lock "cinder-5dade274-7cff-4030-be98-43d1ac212503-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Lock "cinder-5dade274-7cff-4030-be98-43d1ac212503-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Acquiring lock "cinder-quobyte-5dade274-7cff-4030-be98-43d1ac212503" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Lock "cinder-quobyte-5dade274-7cff-4030-be98-43d1ac212503" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2157a0a6-c13e-4aaa-bc0d-1387ed9f213a]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5dade274-7cff-4030-be98-43d1ac212503 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:11 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.680s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:37:11 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Deleted volume successfully.
Apr 29 10:37:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-6c7c02ca-74ea-49bb-b03b-9fb9eab0829a tempest-VolumesListAdminTestJSON-1932606975 None] Lock "cinder-f792dab0-3cc7-44e8-b3cb-9e15bc90312c-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:12 devstack sudo[109425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5dade274-7cff-4030-be98-43d1ac212503
Apr 29 10:37:12 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:12 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999" returned: 0 in 0.822s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:12 devstack sudo[109428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999
Apr 29 10:37:12 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:12 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-c8f2fa40-108a-452d-9ed1-844c1d5de999" returned: 0 in 0.615s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:12 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5dade274-7cff-4030-be98-43d1ac212503" returned: 0 in 0.763s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5dade274-7cff-4030-be98-43d1ac212503 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:12 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Lock "cinder-quobyte-c8f2fa40-108a-452d-9ed1-844c1d5de999" released by "delete_volume" :: held 1.510s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:12 devstack sudo[109434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5dade274-7cff-4030-be98-43d1ac212503
Apr 29 10:37:12 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:12 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Created reservations ['27adc8f5-f6ac-4663-993c-e1f51359e2fd', 'ccf4a417-d18e-4641-9de4-f37b639ec9f4', '06b0761e-bddb-4972-b7c3-3b66257b72b6', '2b9e3f0f-7e02-4511-bd6f-1e154da404bc'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:37:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:12 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:12 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:12 devstack sudo[109436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:37:12 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:13 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5dade274-7cff-4030-be98-43d1ac212503" returned: 0 in 0.581s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:13 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Lock "cinder-quobyte-5dade274-7cff-4030-be98-43d1ac212503" released by "delete_volume" :: held 1.409s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:13 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Created reservations ['5405a9e5-eddc-41c0-9603-ab2ac8ea90fd', '098b0229-0908-428a-934d-ee30deea7b6b', 'f588921b-ae63-41e5-a118-353ce557369b', '148ec647-59c8-4bc2-9b65-9cf92333d533'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:37:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:13 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:13 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.628s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:13 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:37:13 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Deleted volume successfully.
Apr 29 10:37:13 devstack sudo[109440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:37:13 devstack sudo[109440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:13 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b579acc0-2a04-4cfa-be3e-c42e55e4d249 tempest-TestStampPattern-2086329137 None] Lock "cinder-c8f2fa40-108a-452d-9ed1-844c1d5de999-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:14 devstack sudo[109440]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.614s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:14 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:37:14 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Deleted volume successfully.
Apr 29 10:37:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-efb42651-d606-4dcd-8d1a-182e45fdc33b tempest-VolumesListAdminTestJSON-1932606975 None] Lock "cinder-5dade274-7cff-4030-be98-43d1ac212503-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Acquiring lock "cinder-bb547bae-06e6-4207-a363-02896e58c806-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Lock "cinder-bb547bae-06e6-4207-a363-02896e58c806-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Acquiring lock "cinder-quobyte-bb547bae-06e6-4207-a363-02896e58c806" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Lock "cinder-quobyte-bb547bae-06e6-4207-a363-02896e58c806" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:14 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d493b969-38e7-4670-8700-0261bc5f3d3e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bb547bae-06e6-4207-a363-02896e58c806 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:14 devstack sudo[109444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bb547bae-06e6-4207-a363-02896e58c806
Apr 29 10:37:14 devstack sudo[109444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:14 devstack sudo[109444]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bb547bae-06e6-4207-a363-02896e58c806" returned: 0 in 0.701s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bb547bae-06e6-4207-a363-02896e58c806 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:14 devstack sudo[109449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bb547bae-06e6-4207-a363-02896e58c806
Apr 29 10:37:14 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:15 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bb547bae-06e6-4207-a363-02896e58c806" returned: 0 in 0.623s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Lock "cinder-quobyte-bb547bae-06e6-4207-a363-02896e58c806" released by "delete_volume" :: held 1.376s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:15 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Created reservations ['916ea232-60ef-4e81-927b-aeda1057a8a1', 'db0a0d35-c793-4306-99d0-000de2140ca0', '74a32ca0-b078-4a11-acc9-5acc8c126c43', '6b6f505b-4acb-4bb7-bc6f-798a0ab449c3'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:37:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:15 devstack sudo[109453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:37:15 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:16 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.696s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:16 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:37:16 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Deleted volume successfully.
Apr 29 10:37:16 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-b87e0b20-bbfe-4b63-aeb9-d4d825ffe471 tempest-VolumesListAdminTestJSON-1932606975 None] Lock "cinder-bb547bae-06e6-4207-a363-02896e58c806-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Flow 'volume_create_manager' (d9ad0ffc-cd54-4974-803d-d2048d765440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff7e9af-33f4-461c-9584-96746702d8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff7e9af-33f4-461c-9584-96746702d8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-577261883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06372c9a3a04faf87b267eba85f6d04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:21Z,use_quota=True,user_id='b3633967808841f2a7dcf2ef8cc293e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5947408-10e5-4eac-ad0a-f0f1e69ce295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5947408-10e5-4eac-ad0a-f0f1e69ce295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56679eb-c403-4d73-8f7f-f584ac7098e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56679eb-c403-4d73-8f7f-f584ac7098e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6', 'volume_name': 'volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df23e5ed-ed73-4182-a307-65e4f4b1d820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df23e5ed-ed73-4182-a307-65e4f4b1d820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0160eb-9ab7-4b5a-8b57-97a0e4c0140d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:20 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Volume 3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6', 'volume_size': 1}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-577261883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06372c9a3a04faf87b267eba85f6d04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:21Z,use_quota=True,user_id='b3633967808841f2a7dcf2ef8cc293e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Creating volume 3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:37:20 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:37:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:20 devstack sudo[109458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6 1073741824
Apr 29 10:37:20 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:21 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6 1073741824" returned: 0 in 0.838s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:21 devstack sudo[109465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6
Apr 29 10:37:21 devstack sudo[109465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:22 devstack sudo[109465]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6" returned: 0 in 0.668s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:37:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0160eb-9ab7-4b5a-8b57-97a0e4c0140d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02979317-10f6-46da-83ed-04ec6c506a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:22 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Volume volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6 (3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6): created successfully
Apr 29 10:37:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02979317-10f6-46da-83ed-04ec6c506a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Flow 'volume_create_manager' (d9ad0ffc-cd54-4974-803d-d2048d765440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:37:22 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c0ea8154-0773-40c8-90b8-1439e7e93617 tempest-SnapshotMetadataTestJSON-1151406943 None] Created volume successfully.
Apr 29 10:37:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] Creating offline snapshot 7f8bdc85-0ee7-49a8-b73a-1b283c806cb3 of volume 3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:37:23 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b395e32-bffd-4aca-83b4-f9c50c1293a9]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:23 devstack sudo[109474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6
Apr 29 10:37:23 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:23 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6" returned: 0 in 0.763s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:23 devstack sudo[109481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3 1G
Apr 29 10:37:23 devstack sudo[109481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:24 devstack sudo[109481]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3 1G" returned: 0 in 0.834s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:24 devstack sudo[109488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3
Apr 29 10:37:24 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:25 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3" returned: 0 in 0.681s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:25 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3 is being set with open permissions: ugo+rw
Apr 29 10:37:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:25 devstack sudo[109494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3
Apr 29 10:37:25 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:26 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3" returned: 0 in 0.699s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:26 devstack sudo[109532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.info
Apr 29 10:37:26 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:26 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.info" returned: 0 in 0.650s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:26 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.info is being set with open permissions: ugo+rw
Apr 29 10:37:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:26 devstack sudo[109537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.info
Apr 29 10:37:26 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:27 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.info" returned: 0 in 0.626s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.379s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:27 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-d83589a5-62ed-4cb2-a6d7-c51c172fc99c tempest-SnapshotMetadataTestJSON-1151406943 None] Create snapshot completed successfully
Apr 29 10:37:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Acquiring lock "cinder-7f8bdc85-0ee7-49a8-b73a-1b283c806cb3-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "cinder-7f8bdc85-0ee7-49a8-b73a-1b283c806cb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Acquiring lock "cinder-quobyte-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "cinder-quobyte-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Acquiring lock "cinder-quobyte-7f8bdc85-0ee7-49a8-b73a-1b283c806cb3" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:28 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "cinder-quobyte-7f8bdc85-0ee7-49a8-b73a-1b283c806cb3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Deleting offline snapshot 7f8bdc85-0ee7-49a8-b73a-1b283c806cb3 of volume 3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:37:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] snapshot_file for this snap is: volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:37:29 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[412ca159-f78b-4d4a-b8ea-1f4b4e8e231c]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:29 devstack sudo[109542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3
Apr 29 10:37:29 devstack sudo[109542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:29 devstack sudo[109542]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3" returned: 0 in 0.770s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:37:29 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b28fa0-8d97-4d64-b213-141d2c8cbc18]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:29 devstack sudo[109547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6
Apr 29 10:37:29 devstack sudo[109547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:30 devstack sudo[109547]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6" returned: 0 in 0.882s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:30 devstack sudo[109552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3
Apr 29 10:37:30 devstack sudo[109552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:31 devstack sudo[109552]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3" returned: 0 in 0.751s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:31 devstack sudo[109559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3
Apr 29 10:37:31 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:32 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6.7f8bdc85-0ee7-49a8-b73a-1b283c806cb3" returned: 0 in 0.650s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "cinder-quobyte-7f8bdc85-0ee7-49a8-b73a-1b283c806cb3" released by "_delete_snapshot" :: held 3.170s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "cinder-quobyte-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6" released by "delete_snapshot" :: held 3.198s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:32 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Created reservations ['ca8ef7b7-2a78-458c-b94b-aa537e50c87b', '6b75ec9e-e367-4a04-82ce-090a2470f0b9', '94d6e2cc-b2c6-4277-858b-454097e98f64', 'd4058593-2573-4967-83c0-2331921ef441'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:37:32 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Delete snapshot completed successfully.
Apr 29 10:37:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a015db40-3e49-4e80-8bea-38c01088b0dd tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "cinder-7f8bdc85-0ee7-49a8-b73a-1b283c806cb3-delete_snapshot" released by "delete_snapshot" :: held 3.355s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Acquiring lock "cinder-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "cinder-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Acquiring lock "cinder-quobyte-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "cinder-quobyte-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:33 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[26537f55-5e76-4bbc-a89f-0db7c452f92b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:33 devstack sudo[109562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6
Apr 29 10:37:33 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:34 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6" returned: 0 in 0.713s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:34 devstack sudo[109568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6
Apr 29 10:37:34 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:34 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6" returned: 0 in 0.619s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "cinder-quobyte-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6" released by "delete_volume" :: held 1.401s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:34 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Created reservations ['06374b4e-7292-4cfa-84ce-110ba91ea3e0', '132fbf99-42f3-43b1-8f12-d4d466d69f93', '57951745-7ae0-49b3-838a-cf363af9fde3', '38119694-7cec-40f7-b3ca-461b80e321c7'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:37:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:34 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:34 devstack sudo[109571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:37:34 devstack sudo[109571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:35 devstack sudo[109571]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.667s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:35 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:37:35 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Deleted volume successfully.
Apr 29 10:37:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df296827-43ed-4523-b76d-c019e659ad51 tempest-SnapshotMetadataTestJSON-1151406943 None] Lock "cinder-3135ea3f-d2fa-4cb2-bf3d-b01c79f4a3a6-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Flow 'volume_create_manager' (311e7693-4f6c-44ca-9f3b-6eb3413d2c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84433c2-a76c-4030-80fe-bf9fdc28d200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84433c2-a76c-4030-80fe-bf9fdc28d200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-678963169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0fe3ca-e6cc-4075-91e1-9af0216086f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f45dedb641495f82352648e7d174d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:42Z,use_quota=True,user_id='9e2051e9d81843349c8db662d75d09aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c50be7c-07b9-4858-a560-9f67cf38999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c50be7c-07b9-4858-a560-9f67cf38999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4a1070-ec86-41b2-b616-060f6916db0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4a1070-ec86-41b2-b616-060f6916db0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c0fe3ca-e6cc-4075-91e1-9af0216086f1', 'volume_name': 'volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa477ca-563f-4582-819a-8dc8849232cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa477ca-563f-4582-819a-8dc8849232cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c28e42-be69-440f-9cf9-d0214b4434ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:42 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Volume 3c0fe3ca-e6cc-4075-91e1-9af0216086f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1', 'volume_size': 1}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-678963169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0fe3ca-e6cc-4075-91e1-9af0216086f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f45dedb641495f82352648e7d174d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:42Z,use_quota=True,user_id='9e2051e9d81843349c8db662d75d09aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Creating volume 3c0fe3ca-e6cc-4075-91e1-9af0216086f1 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:37:42 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:37:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:42 devstack sudo[109575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1 1073741824
Apr 29 10:37:42 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:43 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1 1073741824" returned: 0 in 0.841s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Flow 'volume_create_manager' (0082a7a3-8d65-4a21-a773-cccb6633f15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b392d623-bca9-4dce-b365-7db2e8070aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b392d623-bca9-4dce-b365-7db2e8070aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-527576146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc831f2-e4f0-4d8a-b198-b7e18947d330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b60c16d29de460baeefa2356a9f6dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:43Z,use_quota=True,user_id='9873a8b4001347039e67eee5cd8ac1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f301877-b569-4bce-883c-1ae761c0c55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f301877-b569-4bce-883c-1ae761c0c55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0287d76f-ecdc-425b-bcf2-6ccf30212cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG cinder.image.glance [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Creating Keystone auth plugin from conf {{(pid=84165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:43 devstack sudo[109581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1
Apr 29 10:37:43 devstack sudo[109581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0287d76f-ecdc-425b-bcf2-6ccf30212cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9bc831f2-e4f0-4d8a-b198-b7e18947d330', 'volume_name': 'volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5246935850>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023dcc75-72bb-4975-bf8d-a259f342f9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023dcc75-72bb-4975-bf8d-a259f342f9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e983e5-4625-4a5c-9829-c58b19872ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:43 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Volume 9bc831f2-e4f0-4d8a-b198-b7e18947d330: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5246935850>}
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Trying to clone 9bc831f2-e4f0-4d8a-b198-b7e18947d330 from image 718e863a-88e0-4753-95be-273177fb3fd1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]). {{(pid=84165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 29 10:37:43 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_xostfpy1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 10:37:43 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1332c99-d253-4c0a-a99a-0b095d9edbad]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_xostfpy1devstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:44 devstack sudo[109581]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1" returned: 0 in 0.638s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c28e42-be69-440f-9cf9-d0214b4434ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7e3fa6-db7c-4469-81fa-d0e7cbd3b9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:44 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Volume volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1 (3c0fe3ca-e6cc-4075-91e1-9af0216086f1): created successfully
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7e3fa6-db7c-4469-81fa-d0e7cbd3b9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Flow 'volume_create_manager' (311e7693-4f6c-44ca-9f3b-6eb3413d2c8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:37:44 devstack sudo[109586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_xostfpy1devstack@QuobyteHD
Apr 29 10:37:44 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:44 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c19ea8ab-6655-4b63-9917-8a75017e9412 tempest-AbsoluteLimitsTests-1520977118 None] Created volume successfully.
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Acquiring lock "cinder-3c0fe3ca-e6cc-4075-91e1-9af0216086f1-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Lock "cinder-3c0fe3ca-e6cc-4075-91e1-9af0216086f1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Acquiring lock "cinder-quobyte-3c0fe3ca-e6cc-4075-91e1-9af0216086f1" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:44 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Lock "cinder-quobyte-3c0fe3ca-e6cc-4075-91e1-9af0216086f1" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_xostfpy1devstack@QuobyteHD" returned: 0 in 0.721s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 is fetched for user 9873a8b4001347039e67eee5cd8ac1d6. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11ac7c1-9096-40eb-bea8-1c0bef35693d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d0501f-ef97-4192-9393-51c929bc554e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_xostfpy1devstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:44 devstack sudo[109591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1
Apr 29 10:37:44 devstack sudo[109591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:44 devstack sudo[109592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_xostfpy1devstack@QuobyteHD
Apr 29 10:37:44 devstack sudo[109592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:45 devstack sudo[109591]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1" returned: 0 in 0.728s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:45 devstack sudo[109601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1
Apr 29 10:37:45 devstack sudo[109601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:45 devstack sudo[109592]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_xostfpy1devstack@QuobyteHD" returned: 0 in 0.712s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-527576146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc831f2-e4f0-4d8a-b198-b7e18947d330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b60c16d29de460baeefa2356a9f6dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:43Z,use_quota=True,user_id='9873a8b4001347039e67eee5cd8ac1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:37:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Creating volume 9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:37:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:37:45 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:37:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:45 devstack sudo[109603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 1073741824
Apr 29 10:37:45 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:46 devstack sudo[109601]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3c0fe3ca-e6cc-4075-91e1-9af0216086f1" returned: 0 in 0.586s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Lock "cinder-quobyte-3c0fe3ca-e6cc-4075-91e1-9af0216086f1" released by "delete_volume" :: held 1.356s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:46 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Created reservations ['27a1e41e-06a3-4d6f-8626-e3fecbf04488', 'cde47e7c-a046-40b1-9891-8f7e525253b8', 'e72c9cf1-e7e4-40f1-9d4e-658fc68e4338', 'a52de226-dcdf-4266-a8f8-e903b8816f5f'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:37:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:46 devstack sudo[109609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:37:46 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:46 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 1073741824" returned: 0 in 0.803s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:46 devstack sudo[109611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330
Apr 29 10:37:46 devstack sudo[109611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:46 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.615s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:46 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:37:46 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Deleted volume successfully.
Apr 29 10:37:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e7fd75ea-8a2a-46e3-b093-98558a7479f3 tempest-AbsoluteLimitsTests-1520977118 None] Lock "cinder-3c0fe3ca-e6cc-4075-91e1-9af0216086f1-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:47 devstack sudo[109611]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330" returned: 0 in 0.631s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:37:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:47 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Attempting download of 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume 9bc831f2-e4f0-4d8a-b198-b7e18947d330. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 10:37:47 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff29ae49-001a-4210-9016-6b09d9e28ab2]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_joa7w7w1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:47 devstack sudo[109615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_joa7w7w1
Apr 29 10:37:47 devstack sudo[109615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:47 devstack sudo[109615]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_joa7w7w1" returned: 0 in 0.686s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_joa7w7w1 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:47 devstack sudo[109619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_joa7w7w1
Apr 29 10:37:47 devstack sudo[109619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:48 devstack sudo[109619]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_joa7w7w1" returned: 1 in 0.745s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_718e863a-88e0-4753-95be-273177fb3fd1_joa7w7w1' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:37:48 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f91fc2d-c36b-4743-8e2b-fce90865babd]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_xostfpy1devstack@QuobyteHD {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:48 devstack sudo[109623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_xostfpy1devstack@QuobyteHD
Apr 29 10:37:48 devstack sudo[109623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:49 devstack sudo[109623]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_xostfpy1devstack@QuobyteHD" returned: 0 in 0.718s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:49 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] 718e863a-88e0-4753-95be-273177fb3fd1 was qcow2, converting to raw {{(pid=84165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 10:37:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_xostfpy1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:49 devstack sudo[109629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_xostfpy1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330
Apr 29 10:37:49 devstack sudo[109629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:50 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:37:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Flow 'volume_create_manager' (cb6be73b-b942-4430-b940-b957d1d7a695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:37:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbef134b-62c7-43c1-969a-046d9ac74654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbef134b-62c7-43c1-969a-046d9ac74654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-177855279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7097f4b24b644948a6857d1b1a941f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:51Z,use_quota=True,user_id='e9a4c7503ecc4853a6af028eeef3ef96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98aeb853-82e0-419c-bd08-dd4fae3ffa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98aeb853-82e0-419c-bd08-dd4fae3ffa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:50 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9959ed-f826-423d-884f-e75b51c56f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9959ed-f826-423d-884f-e75b51c56f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4', 'volume_name': 'volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc2f5e7-1d7c-431f-a701-d92315330e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc2f5e7-1d7c-431f-a701-d92315330e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f92a04c-91e1-493b-b30d-03eebf817b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:51 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Volume dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4', 'volume_size': 1}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-177855279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7097f4b24b644948a6857d1b1a941f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:51Z,use_quota=True,user_id='e9a4c7503ecc4853a6af028eeef3ef96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Creating volume dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:37:51 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:51 devstack sudo[109637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4 1073741824
Apr 29 10:37:51 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:51 devstack sudo[109629]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_xostfpy1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330" returned: 0 in 1.988s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_718e863a-88e0-4753-95be-273177fb3fd1_xostfpy1devstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:37:51 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Converted 112.00 MB image at 56.28 MB/s
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:51 devstack sudo[109639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 1G
Apr 29 10:37:51 devstack sudo[109639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:51 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4 1073741824" returned: 0 in 0.817s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:51 devstack sudo[109639]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 1G" returned: 0 in 0.657s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:51 devstack sudo[109647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4
Apr 29 10:37:51 devstack sudo[109647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39a4f63-63fe-4c08-82b0-3794f24adaf6]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:52 devstack sudo[109649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330
Apr 29 10:37:52 devstack sudo[109649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:52 devstack sudo[109647]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4" returned: 0 in 0.599s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:37:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f92a04c-91e1-493b-b30d-03eebf817b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9032b032-ee60-4ad1-9b45-747f6036fe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:52 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Volume volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4 (dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4): created successfully
Apr 29 10:37:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9032b032-ee60-4ad1-9b45-747f6036fe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:52 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Flow 'volume_create_manager' (cb6be73b-b942-4430-b940-b957d1d7a695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:37:52 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-802c439e-5c88-4ea9-82e8-7c2878ef833d tempest-VolumesMetadataTest-413782954 None] Created volume successfully.
Apr 29 10:37:52 devstack sudo[109649]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330" returned: 0 in 0.683s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:52 devstack sudo[109654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330
Apr 29 10:37:52 devstack sudo[109654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:53 devstack sudo[109654]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330" returned: 1 in 0.720s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Downloaded image 718e863a-88e0-4753-95be-273177fb3fd1 ((None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}])) to volume 9bc831f2-e4f0-4d8a-b198-b7e18947d330 successfully. {{(pid=84165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Temporary image 718e863a-88e0-4753-95be-273177fb3fd1 for user 9873a8b4001347039e67eee5cd8ac1d6 is deleted. {{(pid=84165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Marking volume 9bc831f2-e4f0-4d8a-b198-b7e18947d330 as bootable. {{(pid=84165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Copying metadata from image 718e863a-88e0-4753-95be-273177fb3fd1 to 9bc831f2-e4f0-4d8a-b198-b7e18947d330. {{(pid=84165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Creating volume glance metadata for volume 9bc831f2-e4f0-4d8a-b198-b7e18947d330 backed by image 718e863a-88e0-4753-95be-273177fb3fd1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e983e5-4625-4a5c-9829-c58b19872ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330', 'volume_size': 1, 'image_id': '718e863a-88e0-4753-95be-273177fb3fd1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/718e863a-88e0-4753-95be-273177fb3fd1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2dd6c338a6f4049a98fdd9e41a3b410', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '718e863a-88e0-4753-95be-273177fb3fd1', 'created_at': datetime.datetime(2026, 4, 29, 8, 7, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 7, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/718e863a-88e0-4753-95be-273177fb3fd1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5246935850>}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd91d221-8536-4d21-9209-1b22d08a52f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:37:53 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Volume volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 (9bc831f2-e4f0-4d8a-b198-b7e18947d330): created successfully
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd91d221-8536-4d21-9209-1b22d08a52f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Flow 'volume_create_manager' (0082a7a3-8d65-4a21-a773-cccb6633f15c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:37:53 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-fb625f54-f8d2-41c4-981e-13dea38b628d tempest-TestVolumeBootPattern-1621965888 None] Created volume successfully.
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Acquiring lock "cinder-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Lock "cinder-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Acquiring lock "cinder-quobyte-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Lock "cinder-quobyte-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4" acquired by "delete_volume" :: waited 0.013s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[59237da6-88bd-4c1d-9d88-76b0f74e82f9]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:53 devstack sudo[109660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4
Apr 29 10:37:53 devstack sudo[109660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:54 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] Creating offline snapshot 5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4 of volume 9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:37:54 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[29894f85-ef35-46bf-8aa9-acdb78b5f204]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:37:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:54 devstack sudo[109662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330
Apr 29 10:37:54 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:54 devstack sudo[109660]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4" returned: 0 in 0.727s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:54 devstack sudo[109667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4
Apr 29 10:37:54 devstack sudo[109667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:55 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330" returned: 0 in 0.714s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:55 devstack sudo[109667]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4" returned: 0 in 0.611s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Lock "cinder-quobyte-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4" released by "delete_volume" :: held 1.376s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:55 devstack sudo[109672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330
Apr 29 10:37:55 devstack sudo[109672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Created reservations ['edc0e0d3-58e9-4944-878c-e48e326aee27', '30e66dd3-3113-4eaa-842a-06aae940d4e2', 'deb11c6e-f320-44f6-adb1-b330a29483e5', '50897d76-96b3-4b40-ad4d-3cbaf5132300'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:55 devstack sudo[109674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:37:55 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:55 devstack sudo[109672]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330" returned: 1 in 0.685s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330,backing_fmt=raw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:55 devstack sudo[109680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330,backing_fmt=raw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4 1G
Apr 29 10:37:55 devstack sudo[109680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:55 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.598s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:37:55 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Deleted volume successfully.
Apr 29 10:37:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-19414e58-f547-403e-9d86-8848a794a824 tempest-VolumesMetadataTest-413782954 None] Lock "cinder-dd83eed5-6a13-409d-adcd-c7ae9ec9cdb4-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:37:56 devstack sudo[109680]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330,backing_fmt=raw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4 1G" returned: 0 in 0.849s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 -F raw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:56 devstack sudo[109685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 -F raw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4
Apr 29 10:37:56 devstack sudo[109685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:57 devstack sudo[109685]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 -F raw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4" returned: 0 in 0.677s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:57 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4 is being set with open permissions: ugo+rw
Apr 29 10:37:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:57 devstack sudo[109691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4
Apr 29 10:37:57 devstack sudo[109691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:57 devstack sudo[109691]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4" returned: 0 in 0.615s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:57 devstack sudo[109694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.info
Apr 29 10:37:57 devstack sudo[109694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:58 devstack sudo[109694]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.info" returned: 0 in 0.648s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:58 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.info is being set with open permissions: ugo+rw
Apr 29 10:37:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:37:58 devstack sudo[109697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.info
Apr 29 10:37:58 devstack sudo[109697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:37:59 devstack sudo[109697]: pam_unix(sudo:session): session closed for user root
Apr 29 10:37:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.info" returned: 0 in 0.580s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:37:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.884s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:37:59 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1e7285af-83a4-4ae5-8ba1-9f0ee1a9c05c tempest-TestVolumeBootPattern-1621965888 None] Create snapshot completed successfully
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Flow 'volume_create_manager' (1f6e156b-8e6b-4d79-836f-afd44ad5ae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b15700a-aa10-4292-889a-1186b4a83797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b15700a-aa10-4292-889a-1186b4a83797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1632157433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc46285e-acf9-44ab-af65-020b0318a62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4543ba05c73041c4929849e2f9d9d3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:00Z,use_quota=True,user_id='7746f5bdae32470782fb996b70f84c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1b1c8f-5d1a-4d88-b110-e2e3bfb9a6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1b1c8f-5d1a-4d88-b110-e2e3bfb9a6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8978939-3c39-40ff-8c08-a3786246a6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8978939-3c39-40ff-8c08-a3786246a6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc46285e-acf9-44ab-af65-020b0318a62e', 'volume_name': 'volume-bc46285e-acf9-44ab-af65-020b0318a62e', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c0c7ad-b19a-49c1-b517-58adab587442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c0c7ad-b19a-49c1-b517-58adab587442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a95009-05ef-49e2-a297-04ab6c8f54ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:00 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Volume bc46285e-acf9-44ab-af65-020b0318a62e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc46285e-acf9-44ab-af65-020b0318a62e', 'volume_size': 1}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1632157433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc46285e-acf9-44ab-af65-020b0318a62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4543ba05c73041c4929849e2f9d9d3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:00Z,use_quota=True,user_id='7746f5bdae32470782fb996b70f84c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Creating volume bc46285e-acf9-44ab-af65-020b0318a62e {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:38:00 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:38:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bc46285e-acf9-44ab-af65-020b0318a62e 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:00 devstack sudo[109700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bc46285e-acf9-44ab-af65-020b0318a62e 1073741824
Apr 29 10:38:00 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:01 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bc46285e-acf9-44ab-af65-020b0318a62e 1073741824" returned: 0 in 0.830s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bc46285e-acf9-44ab-af65-020b0318a62e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:01 devstack sudo[109708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bc46285e-acf9-44ab-af65-020b0318a62e
Apr 29 10:38:01 devstack sudo[109708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:01 devstack sudo[109708]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bc46285e-acf9-44ab-af65-020b0318a62e" returned: 0 in 0.596s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:38:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a95009-05ef-49e2-a297-04ab6c8f54ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc46285e-acf9-44ab-af65-020b0318a62e', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58836879-5fd9-44d2-b11c-8fbd4f75f552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:01 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Volume volume-bc46285e-acf9-44ab-af65-020b0318a62e (bc46285e-acf9-44ab-af65-020b0318a62e): created successfully
Apr 29 10:38:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58836879-5fd9-44d2-b11c-8fbd4f75f552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Flow 'volume_create_manager' (1f6e156b-8e6b-4d79-836f-afd44ad5ae52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:38:01 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e7a7d368-7955-4e8e-8f94-ab07a47e1628 tempest-VolumesTransfersTest-2142077985 None] Created volume successfully.
Apr 29 10:38:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1a4cf0f4-e545-482c-b595-bef9ebb02993 tempest-VolumesTransfersTest-836323717 None] Transfer volume completed successfully.
Apr 29 10:38:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Acquiring lock "cinder-bc46285e-acf9-44ab-af65-020b0318a62e-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Lock "cinder-bc46285e-acf9-44ab-af65-020b0318a62e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Acquiring lock "cinder-quobyte-bc46285e-acf9-44ab-af65-020b0318a62e" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Lock "cinder-quobyte-bc46285e-acf9-44ab-af65-020b0318a62e" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:03 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2c7018-8d9f-44d0-a4a1-2b30718c565f]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bc46285e-acf9-44ab-af65-020b0318a62e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:03 devstack sudo[109712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bc46285e-acf9-44ab-af65-020b0318a62e
Apr 29 10:38:03 devstack sudo[109712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:04 devstack sudo[109712]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bc46285e-acf9-44ab-af65-020b0318a62e" returned: 0 in 0.726s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bc46285e-acf9-44ab-af65-020b0318a62e {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:04 devstack sudo[109717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bc46285e-acf9-44ab-af65-020b0318a62e
Apr 29 10:38:04 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:05 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-bc46285e-acf9-44ab-af65-020b0318a62e" returned: 0 in 0.587s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Lock "cinder-quobyte-bc46285e-acf9-44ab-af65-020b0318a62e" released by "delete_volume" :: held 1.356s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Created reservations ['3371687b-252c-46db-b7fd-9129372f2e5f', 'e5522f77-9a14-48e9-b869-2ff43a758e01', '34207f3f-fdc2-4fb5-a69a-43ef68582533', '92ed8193-ddf7-45f1-a609-7c6fdb5ac87d'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:05 devstack sudo[109720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:38:05 devstack sudo[109720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:05 devstack sudo[109722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:38:05 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:05 devstack sudo[109720]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.696s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:38:05 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Deleted volume successfully.
Apr 29 10:38:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c6ea1706-c558-4bd8-bdf1-6ab9a8093e3d tempest-VolumesTransfersTest-1488538933 None] Lock "cinder-bc46285e-acf9-44ab-af65-020b0318a62e-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:06 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.673s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Flow 'volume_create_manager' (dc62c51b-26d3-432c-aceb-a735107b048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd37d816-7e86-44f7-b03e-01a4156cf118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd37d816-7e86-44f7-b03e-01a4156cf118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1597521688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb9fa92-372f-46fa-9388-318ea3eb61c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4543ba05c73041c4929849e2f9d9d3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:07Z,use_quota=True,user_id='7746f5bdae32470782fb996b70f84c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c270d9c2-f5e6-4a2e-9d71-b7f1cb480650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c270d9c2-f5e6-4a2e-9d71-b7f1cb480650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc395762-4d82-492d-a11e-c1a9f0cf31c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc395762-4d82-492d-a11e-c1a9f0cf31c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bb9fa92-372f-46fa-9388-318ea3eb61c8', 'volume_name': 'volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d1f4102-be79-470f-8835-f643c5d0e826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d1f4102-be79-470f-8835-f643c5d0e826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8cda1e-d0d3-4b1f-b316-c514bfde2fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:06 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Volume 9bb9fa92-372f-46fa-9388-318ea3eb61c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8', 'volume_size': 1}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1597521688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb9fa92-372f-46fa-9388-318ea3eb61c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4543ba05c73041c4929849e2f9d9d3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:07Z,use_quota=True,user_id='7746f5bdae32470782fb996b70f84c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Creating volume 9bb9fa92-372f-46fa-9388-318ea3eb61c8 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:38:06 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:38:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:06 devstack sudo[109726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8 1073741824
Apr 29 10:38:06 devstack sudo[109726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=81,cinder:INSERT=41,cinder:UPDATE=100,cinder:DELETE=7 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=102,cinder:DELETE=10,cinder:SELECT=80,cinder:INSERT=33 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Flow 'volume_create_manager' (b564f635-1a71-4eff-9bd3-b92021c8f945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0894a867-d885-4a92-b12f-21b319856c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0894a867-d885-4a92-b12f-21b319856c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:38:07Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c4b74b2-4e07-48aa-89c7-e2600950cc30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b60c16d29de460baeefa2356a9f6dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:08Z,use_quota=True,user_id='9873a8b4001347039e67eee5cd8ac1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b8ee66-9485-416c-8cec-2727eba7324a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b8ee66-9485-416c-8cec-2727eba7324a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5401483a-7caa-4271-bfab-0966b3e2edf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5401483a-7caa-4271-bfab-0966b3e2edf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4c4b74b2-4e07-48aa-89c7-e2600950cc30', 'volume_name': 'volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30', 'volume_size': 1, 'snapshot_id': '5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9a997f-391d-489f-9e62-10c6835f48b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9a997f-391d-489f-9e62-10c6835f48b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cfcf8b-eb85-4a2a-8b7a-64124540e827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:07 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Volume 4c4b74b2-4e07-48aa-89c7-e2600950cc30: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30', 'volume_size': 1, 'snapshot_id': '5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4'}
Apr 29 10:38:07 devstack sudo[109726]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8 1073741824" returned: 0 in 0.970s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:07 devstack sudo[109732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8
Apr 29 10:38:07 devstack sudo[109732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:08 devstack sudo[109732]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8" returned: 0 in 0.628s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.669s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Acquiring lock "cinder-quobyte-5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4-4c4b74b2-4e07-48aa-89c7-e2600950cc30" by "_create_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8cda1e-d0d3-4b1f-b316-c514bfde2fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90998abb-c5a9-4e45-8bbc-c4bf07c5e491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Lock "cinder-quobyte-5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4-4c4b74b2-4e07-48aa-89c7-e2600950cc30" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Creating volume 4c4b74b2-4e07-48aa-89c7-e2600950cc30 from snapshot 5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4 {{(pid=84165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Acquiring lock "cinder-quobyte-4c4b74b2-4e07-48aa-89c7-e2600950cc30" by "_copy_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Lock "cinder-quobyte-4c4b74b2-4e07-48aa-89c7-e2600950cc30" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] snapshot: 5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4, volume: 4c4b74b2-4e07-48aa-89c7-e2600950cc30,  {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 10:38:08 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Volume volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8 (9bb9fa92-372f-46fa-9388-318ea3eb61c8): created successfully
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90998abb-c5a9-4e45-8bbc-c4bf07c5e491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Flow 'volume_create_manager' (dc62c51b-26d3-432c-aceb-a735107b048e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:08 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-2edc2667-a2ac-4dae-a6a8-1490d7adc63e tempest-VolumesTransfersTest-2142077985 None] Created volume successfully.
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[899bec59-73d7-4589-ada8-950f1debac8f]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:08 devstack sudo[109735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4
Apr 29 10:38:08 devstack sudo[109735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Acquiring lock "cinder-9bb9fa92-372f-46fa-9388-318ea3eb61c8-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Lock "cinder-9bb9fa92-372f-46fa-9388-318ea3eb61c8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Acquiring lock "cinder-quobyte-9bb9fa92-372f-46fa-9388-318ea3eb61c8" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Lock "cinder-quobyte-9bb9fa92-372f-46fa-9388-318ea3eb61c8" acquired by "delete_volume" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:09 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae4508c-1772-4052-a7cc-74336f8f9614]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:09 devstack sudo[109735]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4" returned: 0 in 0.775s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:38:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 10:38:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Creating direct copy from snapshot {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 10:38:09 devstack sudo[109740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8
Apr 29 10:38:09 devstack sudo[109740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:09 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a437bcc-1578-4084-855e-cbab99bdfbb4]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:09 devstack sudo[109742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330
Apr 29 10:38:09 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:09 devstack sudo[109740]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8" returned: 0 in 0.731s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:09 devstack sudo[109748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8
Apr 29 10:38:09 devstack sudo[109748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:10 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330" returned: 0 in 0.736s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:10 devstack sudo[109751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330
Apr 29 10:38:10 devstack sudo[109751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:10 devstack sudo[109748]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bb9fa92-372f-46fa-9388-318ea3eb61c8" returned: 0 in 0.639s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Lock "cinder-quobyte-9bb9fa92-372f-46fa-9388-318ea3eb61c8" released by "delete_volume" :: held 1.427s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:10 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Created reservations ['630a3329-9b74-43b7-86e6-aea486bc9092', '70009917-a76f-424e-b5af-7fffb7b8bf0e', 'ca9cb402-8843-42a1-be29-e758779c266e', '93ca87cf-95fd-4a4b-b2a0-da8446479621'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:38:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:10 devstack sudo[109757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:38:10 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:10 devstack sudo[109751]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330" returned: 1 in 0.735s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:38:10 devstack cinder-volume[84165]: DEBUG cinder.utils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Path /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30 not found in is_blk_device check {{(pid=84165) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 10:38:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:10 devstack sudo[109759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30
Apr 29 10:38:10 devstack sudo[109759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:11 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.668s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:11 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:38:11 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Deleted volume successfully.
Apr 29 10:38:11 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7dcaf355-73f2-4aa8-b7ee-0cf759f2c40f tempest-VolumesTransfersTest-1488538933 None] Lock "cinder-9bb9fa92-372f-46fa-9388-318ea3eb61c8-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:16 devstack sudo[109759]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30" returned: 0 in 6.185s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:17 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb650f5c-781a-4ee0-82e8-51d5c1659329]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:17 devstack sudo[109774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330
Apr 29 10:38:17 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:17 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330" returned: 0 in 0.889s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:18 devstack sudo[109778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330
Apr 29 10:38:18 devstack sudo[109778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:18 devstack sudo[109778]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330" returned: 1 in 0.779s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:38:18 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:38:18 devstack cinder-volume[84165]: INFO cinder.image.image_utils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Converted 1024.00 MB image at 165.53 MB/s
Apr 29 10:38:18 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30 is being set with open permissions: ugo+rw
Apr 29 10:38:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:18 devstack sudo[109783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30
Apr 29 10:38:18 devstack sudo[109783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:19 devstack sudo[109783]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30" returned: 0 in 0.645s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:19 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Lock "cinder-quobyte-4c4b74b2-4e07-48aa-89c7-e2600950cc30" released by "_copy_volume_from_snapshot" :: held 10.917s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:19 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Lock "cinder-quobyte-5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4-4c4b74b2-4e07-48aa-89c7-e2600950cc30" released by "_create_volume_from_snapshot" :: held 10.956s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.984s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:19 devstack cinder-volume[84165]: DEBUG cinder.volume.volume_utils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Marking volume 4c4b74b2-4e07-48aa-89c7-e2600950cc30 as bootable. {{(pid=84165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 10:38:19 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Copying metadata from snapshot 5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4 to 4c4b74b2-4e07-48aa-89c7-e2600950cc30. {{(pid=84165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}}
Apr 29 10:38:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cfcf8b-eb85-4a2a-8b7a-64124540e827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30', 'volume_size': 1, 'snapshot_id': '5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5636a4-7eec-4bd2-9d18-e823e9e06cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:19 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Volume volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30 (4c4b74b2-4e07-48aa-89c7-e2600950cc30): created successfully
Apr 29 10:38:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5636a4-7eec-4bd2-9d18-e823e9e06cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Flow 'volume_create_manager' (b564f635-1a71-4eff-9bd3-b92021c8f945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:38:19 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-09c51c70-7d4e-4c2a-84b7-9f76e2ef12a9 tempest-TestVolumeBootPattern-1621965888 None] Created volume successfully.
Apr 29 10:38:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-48464d82-fa2e-4ae6-b8c3-29a7e1c15bb4 tempest-TestVolumeBootPattern-1621965888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-48464d82-fa2e-4ae6-b8c3-29a7e1c15bb4 tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:20 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead69a7e-567a-4898-9573-34be95d16fc5]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-48464d82-fa2e-4ae6-b8c3-29a7e1c15bb4 tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:20 devstack sudo[109794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30
Apr 29 10:38:20 devstack sudo[109794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:38:21 devstack sudo[109794]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Flow 'volume_create_manager' (8a500f22-a3c6-4277-a1de-d5b0d30783af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb7cf45-b3f1-40b6-ad4e-f43c0951920d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-48464d82-fa2e-4ae6-b8c3-29a7e1c15bb4 tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30" returned: 0 in 0.735s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-48464d82-fa2e-4ae6-b8c3-29a7e1c15bb4 tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.758s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb7cf45-b3f1-40b6-ad4e-f43c0951920d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1644608641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fa745c-c44e-4d28-ae09-e019f36b93c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df162f0a6434e7b9707172b0ba3ef95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:21Z,use_quota=True,user_id='d97d33e62122443b9dae927fb6c1f069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2451c1f7-18fd-443b-9def-c637c4c19615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2451c1f7-18fd-443b-9def-c637c4c19615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e27fcc-ba85-4c56-81a2-075c65e0859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e27fcc-ba85-4c56-81a2-075c65e0859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33fa745c-c44e-4d28-ae09-e019f36b93c4', 'volume_name': 'volume-33fa745c-c44e-4d28-ae09-e019f36b93c4', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b45241f-e8ec-47cf-8611-a29bc843d95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b45241f-e8ec-47cf-8611-a29bc843d95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12406f23-c4b7-4a97-8967-bcf6f18d4eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:21 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Volume 33fa745c-c44e-4d28-ae09-e019f36b93c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33fa745c-c44e-4d28-ae09-e019f36b93c4', 'volume_size': 1}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1644608641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fa745c-c44e-4d28-ae09-e019f36b93c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df162f0a6434e7b9707172b0ba3ef95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:21Z,use_quota=True,user_id='d97d33e62122443b9dae927fb6c1f069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Creating volume 33fa745c-c44e-4d28-ae09-e019f36b93c4 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:38:21 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-33fa745c-c44e-4d28-ae09-e019f36b93c4 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:21 devstack sudo[109799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-33fa745c-c44e-4d28-ae09-e019f36b93c4 1073741824
Apr 29 10:38:21 devstack sudo[109799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-48464d82-fa2e-4ae6-b8c3-29a7e1c15bb4 tempest-TestVolumeBootPattern-1621965888 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c', 'name': 'volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'faa7e908-231d-4c5d-9bde-a4775666258f', 'enforce_multipath': True} {{(pid=84165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 10:38:21 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-899a474e-e2c5-462f-bfc5-61091dcebcdd req-48464d82-fa2e-4ae6-b8c3-29a7e1c15bb4 tempest-TestVolumeBootPattern-1621965888 None] attachment_update completed successfully.
Apr 29 10:38:22 devstack sudo[109799]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-33fa745c-c44e-4d28-ae09-e019f36b93c4 1073741824" returned: 0 in 0.905s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-33fa745c-c44e-4d28-ae09-e019f36b93c4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:22 devstack sudo[109811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-33fa745c-c44e-4d28-ae09-e019f36b93c4
Apr 29 10:38:22 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:22 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-33fa745c-c44e-4d28-ae09-e019f36b93c4" returned: 0 in 0.604s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:38:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12406f23-c4b7-4a97-8967-bcf6f18d4eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33fa745c-c44e-4d28-ae09-e019f36b93c4', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0822c2e5-7e81-45a6-995b-5a4a65d954ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:22 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Volume volume-33fa745c-c44e-4d28-ae09-e019f36b93c4 (33fa745c-c44e-4d28-ae09-e019f36b93c4): created successfully
Apr 29 10:38:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0822c2e5-7e81-45a6-995b-5a4a65d954ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Flow 'volume_create_manager' (8a500f22-a3c6-4277-a1de-d5b0d30783af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:38:22 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-bbd51f6e-0555-43d3-ab22-e49d1d9cb41f tempest-VolumesTransfersV355Test-70342265 None] Created volume successfully.
Apr 29 10:38:23 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8d4033ca-ddaf-4031-a0ee-665c71d040fa tempest-VolumesTransfersV355Test-2126889943 None] Transfer volume completed successfully.
Apr 29 10:38:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Acquiring lock "cinder-33fa745c-c44e-4d28-ae09-e019f36b93c4-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Lock "cinder-33fa745c-c44e-4d28-ae09-e019f36b93c4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Acquiring lock "cinder-quobyte-33fa745c-c44e-4d28-ae09-e019f36b93c4" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Lock "cinder-quobyte-33fa745c-c44e-4d28-ae09-e019f36b93c4" acquired by "delete_volume" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:24 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f079fa-2b12-459c-b3f1-722dc4bfcb0e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-33fa745c-c44e-4d28-ae09-e019f36b93c4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:24 devstack sudo[109886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-33fa745c-c44e-4d28-ae09-e019f36b93c4
Apr 29 10:38:24 devstack sudo[109886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:25 devstack sudo[109886]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-33fa745c-c44e-4d28-ae09-e019f36b93c4" returned: 0 in 0.714s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-33fa745c-c44e-4d28-ae09-e019f36b93c4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:25 devstack sudo[109891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-33fa745c-c44e-4d28-ae09-e019f36b93c4
Apr 29 10:38:25 devstack sudo[109891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:26 devstack sudo[109891]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-33fa745c-c44e-4d28-ae09-e019f36b93c4" returned: 0 in 0.675s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:26 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Lock "cinder-quobyte-33fa745c-c44e-4d28-ae09-e019f36b93c4" released by "delete_volume" :: held 1.451s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:26 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Created reservations ['e2855eee-3384-411a-906f-b4b958595370', 'cc4fe45d-062e-4349-b74f-de6c10c177db', '0bb5e8ea-6147-401c-86dc-6627d1324628', '7e15b0f1-9c87-4f43-81cc-70e1cf4b6826'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:38:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:26 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:26 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:26 devstack sudo[110255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:38:26 devstack sudo[110255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:27 devstack sudo[110255]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.923s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:38:27 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Deleted volume successfully.
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-29f53258-6b76-4056-aad0-007110ae0be3 tempest-VolumesTransfersV355Test-263998716 None] Lock "cinder-33fa745c-c44e-4d28-ae09-e019f36b93c4-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Flow 'volume_create_manager' (14ee9320-9f2d-44a7-b260-2fc55f535d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d737d03c-c852-433c-a297-6f868fb7cd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d737d03c-c852-433c-a297-6f868fb7cd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-252085452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f48edc-bf45-4e60-9231-fd7d6aa51751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df162f0a6434e7b9707172b0ba3ef95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:28Z,use_quota=True,user_id='d97d33e62122443b9dae927fb6c1f069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec3905e-9e00-477f-87c3-c6b39ee141a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec3905e-9e00-477f-87c3-c6b39ee141a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8476f801-a414-45f6-a7c0-f30a5d596ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8476f801-a414-45f6-a7c0-f30a5d596ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f48edc-bf45-4e60-9231-fd7d6aa51751', 'volume_name': 'volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc4d15e-7004-4ff8-9151-1bd034501de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc4d15e-7004-4ff8-9151-1bd034501de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad597ed-3b87-4470-b7d3-bc4219864766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:27 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Volume e1f48edc-bf45-4e60-9231-fd7d6aa51751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751', 'volume_size': 1}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-252085452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f48edc-bf45-4e60-9231-fd7d6aa51751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df162f0a6434e7b9707172b0ba3ef95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:28Z,use_quota=True,user_id='d97d33e62122443b9dae927fb6c1f069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Creating volume e1f48edc-bf45-4e60-9231-fd7d6aa51751 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:38:27 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:38:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:27 devstack sudo[110309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751 1073741824
Apr 29 10:38:27 devstack sudo[110309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:28 devstack sudo[110309]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751 1073741824" returned: 0 in 0.926s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:28 devstack sudo[110315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751
Apr 29 10:38:28 devstack sudo[110315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:29 devstack sudo[110315]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751" returned: 0 in 0.630s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:38:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad597ed-3b87-4470-b7d3-bc4219864766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a0a16d-0db3-437f-8375-b86671ff4ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:29 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Volume volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751 (e1f48edc-bf45-4e60-9231-fd7d6aa51751): created successfully
Apr 29 10:38:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a0a16d-0db3-437f-8375-b86671ff4ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Flow 'volume_create_manager' (14ee9320-9f2d-44a7-b260-2fc55f535d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:38:29 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1fab2932-b969-40df-a37d-1f51a70a89e7 tempest-VolumesTransfersV355Test-70342265 None] Created volume successfully.
Apr 29 10:38:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Acquiring lock "cinder-e1f48edc-bf45-4e60-9231-fd7d6aa51751-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Lock "cinder-e1f48edc-bf45-4e60-9231-fd7d6aa51751-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Acquiring lock "cinder-quobyte-e1f48edc-bf45-4e60-9231-fd7d6aa51751" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Lock "cinder-quobyte-e1f48edc-bf45-4e60-9231-fd7d6aa51751" acquired by "delete_volume" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:30 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eaab5c-fd77-4bff-af2f-8323d66bd925]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:30 devstack sudo[110318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751
Apr 29 10:38:30 devstack sudo[110318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:31 devstack sudo[110318]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751" returned: 0 in 0.789s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:31 devstack sudo[110323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751
Apr 29 10:38:31 devstack sudo[110323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:31 devstack sudo[110323]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e1f48edc-bf45-4e60-9231-fd7d6aa51751" returned: 0 in 0.773s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Lock "cinder-quobyte-e1f48edc-bf45-4e60-9231-fd7d6aa51751" released by "delete_volume" :: held 1.624s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:31 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Created reservations ['65da72db-1cf5-4691-bea0-5f1a66441d68', 'fbe16e07-220b-44df-8dcd-c57d3e00ad48', '3acddfe2-b231-4516-8735-2d613176c98c', '1b19e851-6336-4aa9-a191-bb3888771191'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:38:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:32 devstack sudo[110363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:38:32 devstack sudo[110363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:32 devstack sudo[110363]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.662s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:32 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:38:32 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Deleted volume successfully.
Apr 29 10:38:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-faf0bee4-af3c-49bd-a983-646ffdec0d48 tempest-VolumesTransfersV355Test-263998716 None] Lock "cinder-e1f48edc-bf45-4e60-9231-fd7d6aa51751-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:34 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-02f27130-183d-4589-a9c7-7201099f2c54 req-3ab9af0c-1ed4-4f88-ae2b-906a7638ca2e tempest-TestVolumeBootPattern-1621965888 None] Terminate volume connection completed successfully.
Apr 29 10:38:34 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [req-02f27130-183d-4589-a9c7-7201099f2c54 req-3ab9af0c-1ed4-4f88-ae2b-906a7638ca2e tempest-TestVolumeBootPattern-1621965888 None] Deleting attachment faa7e908-231d-4c5d-9bde-a4775666258f. {{(pid=84165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 10:38:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Acquiring lock "cinder-4c4b74b2-4e07-48aa-89c7-e2600950cc30-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Lock "cinder-4c4b74b2-4e07-48aa-89c7-e2600950cc30-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Acquiring lock "cinder-quobyte-4c4b74b2-4e07-48aa-89c7-e2600950cc30" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Lock "cinder-quobyte-4c4b74b2-4e07-48aa-89c7-e2600950cc30" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:35 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f901fdae-da1e-4113-bb77-a3a3fbad6141]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:35 devstack sudo[110394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30
Apr 29 10:38:35 devstack sudo[110394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:36 devstack sudo[110394]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30" returned: 0 in 0.813s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:36 devstack sudo[110400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30
Apr 29 10:38:36 devstack sudo[110400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:36 devstack sudo[110400]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4c4b74b2-4e07-48aa-89c7-e2600950cc30" returned: 0 in 0.623s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:36 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Lock "cinder-quobyte-4c4b74b2-4e07-48aa-89c7-e2600950cc30" released by "delete_volume" :: held 1.487s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:36 devstack cinder-volume[84165]: DEBUG cinder.quota [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Created reservations ['0da08695-938d-4e86-9997-c9f134950159', '6f402a1d-b429-4b50-8c09-a5701a53d45d', '9465b9c4-237b-4f40-a9e5-8b52eeeb16af', 'b6888276-369d-4cd4-a1b2-ea0a0463e4db'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:38:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:36 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:36 devstack sudo[110403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:38:36 devstack sudo[110403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:37 devstack sudo[110403]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.634s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.manager [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:38:37 devstack cinder-volume[84165]: INFO cinder.volume.manager [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Deleted volume successfully.
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.coordination [req-02f27130-183d-4589-a9c7-7201099f2c54 req-4875e8a8-0719-408c-8990-976ac070bf2b tempest-TestVolumeBootPattern-1621965888 None] Lock "cinder-4c4b74b2-4e07-48aa-89c7-e2600950cc30-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Flow 'volume_create_manager' (f0963675-abf9-476b-8b04-9dd1dc48a8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d0de50-acf9-436f-97a8-8ddbc17c648c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d0de50-acf9-436f-97a8-8ddbc17c648c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1266733520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70aaed57-a9ad-4a92-b6d1-6e30a7a45af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2a97f847df43d8a8745af6b132cc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:38Z,use_quota=True,user_id='39105f501397467ebfcfa4eb27ceb8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0346ad0c-c11b-420a-a621-32154038706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0346ad0c-c11b-420a-a621-32154038706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54957c79-56b3-4120-b6ca-5e1fb0b6fe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54957c79-56b3-4120-b6ca-5e1fb0b6fe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70aaed57-a9ad-4a92-b6d1-6e30a7a45af9', 'volume_name': 'volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ffee09-1918-432c-9afc-a935fa2358fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ffee09-1918-432c-9afc-a935fa2358fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f996bf02-92f9-4267-90bd-768ebb648f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:37 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Volume 70aaed57-a9ad-4a92-b6d1-6e30a7a45af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9', 'volume_size': 1}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1266733520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70aaed57-a9ad-4a92-b6d1-6e30a7a45af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2a97f847df43d8a8745af6b132cc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:38Z,use_quota=True,user_id='39105f501397467ebfcfa4eb27ceb8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Creating volume 70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:38:37 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:38:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:37 devstack sudo[110406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 1073741824
Apr 29 10:38:37 devstack sudo[110406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Acquiring lock "cinder-5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Lock "cinder-5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Acquiring lock "cinder-quobyte-9bc831f2-e4f0-4d8a-b198-b7e18947d330" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Lock "cinder-quobyte-9bc831f2-e4f0-4d8a-b198-b7e18947d330" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Acquiring lock "cinder-quobyte-5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Lock "cinder-quobyte-5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:38 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Deleting offline snapshot 5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4 of volume 9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:38:38 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] snapshot_file for this snap is: volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:38:38 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[63be85e9-eac4-4f3c-bfc0-ebdf4344e771]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:38 devstack sudo[110408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4
Apr 29 10:38:38 devstack sudo[110408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:38 devstack sudo[110406]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 1073741824" returned: 0 in 0.778s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:38 devstack sudo[110414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9
Apr 29 10:38:38 devstack sudo[110414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:39 devstack sudo[110408]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4" returned: 0 in 0.787s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:38:39 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[133cd9ba-7a98-4db4-b587-469507cdd246]: (4, 'raw') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:39 devstack sudo[110419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330
Apr 29 10:38:39 devstack sudo[110419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:39 devstack sudo[110414]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9" returned: 0 in 0.592s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:38:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f996bf02-92f9-4267-90bd-768ebb648f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fcc141-da6f-4436-9ff2-254873d184dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:39 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Volume volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 (70aaed57-a9ad-4a92-b6d1-6e30a7a45af9): created successfully
Apr 29 10:38:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fcc141-da6f-4436-9ff2-254873d184dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Flow 'volume_create_manager' (f0963675-abf9-476b-8b04-9dd1dc48a8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:38:39 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-db892d3e-adc2-4aaf-a43d-8122b6e89bc7 tempest-VolumesCloneTest-294771659 None] Created volume successfully.
Apr 29 10:38:39 devstack sudo[110419]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330" returned: 0 in 0.703s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:39 devstack sudo[110424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330
Apr 29 10:38:39 devstack sudo[110424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:40 devstack sudo[110424]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330" returned: 1 in 0.731s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:40 devstack sudo[110429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4
Apr 29 10:38:40 devstack sudo[110429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Flow 'volume_create_manager' (3a058408-9308-4804-b1f0-484221e38543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420c4043-24d9-4184-a508-ffe5015109e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420c4043-24d9-4184-a508-ffe5015109e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-397895191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d897e0-ab9c-4164-ac6e-949ab7266308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2a97f847df43d8a8745af6b132cc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=70aaed57-a9ad-4a92-b6d1-6e30a7a45af9,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:41Z,use_quota=True,user_id='39105f501397467ebfcfa4eb27ceb8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf938c51-8f8b-4f41-8cf9-5c18b8a6e2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf938c51-8f8b-4f41-8cf9-5c18b8a6e2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a356bc86-aa76-4b36-84ed-1cf9e14ff301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a356bc86-aa76-4b36-84ed-1cf9e14ff301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '21d897e0-ab9c-4164-ac6e-949ab7266308', 'volume_name': 'volume-21d897e0-ab9c-4164-ac6e-949ab7266308', 'volume_size': 2, 'source_volid': '70aaed57-a9ad-4a92-b6d1-6e30a7a45af9', 'source_volstatus': 'available'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79735d08-8321-4ddd-aa7f-628e21334d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79735d08-8321-4ddd-aa7f-628e21334d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe440ce1-687e-43da-90fa-fd0ab838fde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:40 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Volume 21d897e0-ab9c-4164-ac6e-949ab7266308: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-21d897e0-ab9c-4164-ac6e-949ab7266308', 'volume_size': 2, 'source_volid': '70aaed57-a9ad-4a92-b6d1-6e30a7a45af9', 'source_volstatus': 'available'}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:40 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Cloning volume 70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 to volume 21d897e0-ab9c-4164-ac6e-949ab7266308
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Creating offline snapshot c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc of volume 70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d5111b-e9cb-45b8-aa2a-f451d0e6cefe]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:40 devstack sudo[110431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9
Apr 29 10:38:40 devstack sudo[110431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:41 devstack sudo[110429]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4" returned: 134 in 0.948s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4' failed. Not Retrying. {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 10:38:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Lock "cinder-quobyte-5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4" released by "_delete_snapshot" :: held 3.269s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Lock "cinder-quobyte-9bc831f2-e4f0-4d8a-b198-b7e18947d330" released by "delete_snapshot" :: held 3.292s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:41 devstack cinder-volume[84165]: INFO cinder.message.api [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Creating message record for request_id = req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32
Apr 29 10:38:41 devstack sudo[110431]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Lock "cinder-5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4-delete_snapshot" released by "delete_snapshot" :: held 3.346s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server [None req-c18d6ed8-ce9a-4ddc-8cb7-1202b2518d32 tempest-TestVolumeBootPattern-1621965888 None] Exception during message handling: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 29 10:38:41 devstack cinder-volume[84165]: Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4
Apr 29 10:38:41 devstack cinder-volume[84165]: Exit code: 134
Apr 29 10:38:41 devstack cinder-volume[84165]: Stdout: ''
Apr 29 10:38:41 devstack cinder-volume[84165]: Stderr: 'Unexpected error in raw_check_lock_bytes() at block/file-posix.c:944:\nqemu-img: Failed to get "consistent read" lock\n'
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 219, in wrapper
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     skip_clean = func(self, context, snapshot, *args, **kwargs)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator.py", line 235, in fun
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     raise self.value
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1337, in delete_snapshot
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     self.driver.delete_snapshot(snapshot)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator.py", line 235, in fun
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/remotefs.py", line 2152, in delete_snapshot
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     return self._delete_snapshot(snapshot)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator.py", line 235, in fun
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/quobyte.py", line 158, in _delete_snapshot
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     super(QuobyteDriver, self)._delete_snapshot(snapshot)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/remotefs.py", line 1403, in _delete_snapshot
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     self._img_commit(snapshot_path)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/remotefs.py", line 947, in _img_commit
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     self._execute(*cmd, run_as_root=self._execute_as_root)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/utils.py", line 189, in execute
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     return processutils.execute(*cmd, **kwargs)
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 493, in execute
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server     raise ProcessExecutionError(
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9bc831f2-e4f0-4d8a-b198-b7e18947d330.5dfe5d2a-29a2-4a9d-b71c-3452c7fad9c4
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server Exit code: 134
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server Stdout: ''
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server Stderr: 'Unexpected error in raw_check_lock_bytes() at block/file-posix.c:944:\nqemu-img: Failed to get "consistent read" lock\n'
Apr 29 10:38:41 devstack cinder-volume[84165]: ERROR oslo_messaging.rpc.server 
Apr 29 10:38:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9" returned: 0 in 0.814s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:41 devstack sudo[110449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc 1G
Apr 29 10:38:41 devstack sudo[110449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:42 devstack sudo[110449]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc 1G" returned: 0 in 0.807s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:42 devstack sudo[110467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc
Apr 29 10:38:42 devstack sudo[110467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:43 devstack sudo[110467]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc" returned: 0 in 0.688s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:43 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc is being set with open permissions: ugo+rw
Apr 29 10:38:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:43 devstack sudo[110472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc
Apr 29 10:38:43 devstack sudo[110472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:43 devstack sudo[110472]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc" returned: 0 in 0.678s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:43 devstack sudo[110476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.info
Apr 29 10:38:43 devstack sudo[110476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:44 devstack sudo[110476]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.info" returned: 0 in 0.631s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:44 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.info is being set with open permissions: ugo+rw
Apr 29 10:38:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:44 devstack sudo[110479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.info
Apr 29 10:38:44 devstack sudo[110479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:45 devstack sudo[110479]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.info" returned: 0 in 0.631s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Acquiring lock "cinder-quobyte-21d897e0-ab9c-4164-ac6e-949ab7266308" by "_copy_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Lock "cinder-quobyte-21d897e0-ab9c-4164-ac6e-949ab7266308" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] snapshot: c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc, volume: 21d897e0-ab9c-4164-ac6e-949ab7266308,  {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ef105e-89e1-4688-b301-9d499e674666]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:45 devstack sudo[110484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc
Apr 29 10:38:45 devstack sudo[110484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:45 devstack sudo[110484]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc" returned: 0 in 0.716s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Creating direct copy from snapshot {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4e6eaa-810e-4fef-9c15-f1607186756e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:45 devstack sudo[110489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9
Apr 29 10:38:45 devstack sudo[110489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:46 devstack sudo[110489]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9" returned: 0 in 0.700s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:46 devstack cinder-volume[84165]: DEBUG cinder.utils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Path /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-21d897e0-ab9c-4164-ac6e-949ab7266308 not found in is_blk_device check {{(pid=84165) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 10:38:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-21d897e0-ab9c-4164-ac6e-949ab7266308 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:46 devstack sudo[110494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-21d897e0-ab9c-4164-ac6e-949ab7266308
Apr 29 10:38:46 devstack sudo[110494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:51 devstack sudo[110494]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-21d897e0-ab9c-4164-ac6e-949ab7266308" returned: 0 in 4.511s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:51 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[568486f7-393b-497f-8b63-65948ae624d9]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:51 devstack sudo[110507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9
Apr 29 10:38:51 devstack sudo[110507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:51 devstack sudo[110507]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9" returned: 0 in 0.861s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:51 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9, size 1024.00 MB, duration 4.51 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-21d897e0-ab9c-4164-ac6e-949ab7266308 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:38:51 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Converted 1024.00 MB image at 226.95 MB/s
Apr 29 10:38:51 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-21d897e0-ab9c-4164-ac6e-949ab7266308 is being set with open permissions: ugo+rw
Apr 29 10:38:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-21d897e0-ab9c-4164-ac6e-949ab7266308 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:51 devstack sudo[110512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-21d897e0-ab9c-4164-ac6e-949ab7266308
Apr 29 10:38:51 devstack sudo[110512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:52 devstack sudo[110512]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-21d897e0-ab9c-4164-ac6e-949ab7266308" returned: 0 in 0.581s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Lock "cinder-quobyte-21d897e0-ab9c-4164-ac6e-949ab7266308" released by "_copy_volume_from_snapshot" :: held 7.456s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Acquiring lock "cinder-quobyte-c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Lock "cinder-quobyte-c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Deleting offline snapshot c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc of volume 70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:38:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] snapshot_file for this snap is: volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:38:52 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[396c2fab-f215-4c4d-aed2-64180aeb0c0e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:52 devstack sudo[110515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc
Apr 29 10:38:52 devstack sudo[110515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:53 devstack sudo[110515]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc" returned: 0 in 0.729s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:38:53 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47bacb7-34a6-4d89-b71c-2cf9d2b5a0b9]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:53 devstack sudo[110520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9
Apr 29 10:38:53 devstack sudo[110520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:53 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=45,cinder:UPDATE=49,cinder:INSERT=15,cinder:DELETE=3 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:38:54 devstack sudo[110520]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9" returned: 0 in 0.758s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:54 devstack sudo[110526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc
Apr 29 10:38:54 devstack sudo[110526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:54 devstack sudo[110526]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc" returned: 0 in 0.653s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:54 devstack sudo[110531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc
Apr 29 10:38:54 devstack sudo[110531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:55 devstack sudo[110531]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9.c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc" returned: 0 in 0.561s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Lock "cinder-quobyte-c2bc4c91-eef6-42ab-8472-0d3ee19a6cfc" released by "_delete_snapshot" :: held 2.788s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.680s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe440ce1-687e-43da-90fa-fd0ab838fde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d897e0-ab9c-4164-ac6e-949ab7266308', 'volume_size': 2, 'source_volid': '70aaed57-a9ad-4a92-b6d1-6e30a7a45af9', 'source_volstatus': 'available'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a5e117-9b5e-483f-84b6-ed96dc552f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:38:55 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Volume volume-21d897e0-ab9c-4164-ac6e-949ab7266308 (21d897e0-ab9c-4164-ac6e-949ab7266308): created successfully
Apr 29 10:38:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a5e117-9b5e-483f-84b6-ed96dc552f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:38:55 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Flow 'volume_create_manager' (3a058408-9308-4804-b1f0-484221e38543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:38:55 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-88d3e1d5-12c5-4ccc-81a3-7d887f48b721 tempest-VolumesCloneTest-294771659 None] Created volume successfully.
Apr 29 10:38:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Acquiring lock "cinder-21d897e0-ab9c-4164-ac6e-949ab7266308-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Lock "cinder-21d897e0-ab9c-4164-ac6e-949ab7266308-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Acquiring lock "cinder-quobyte-21d897e0-ab9c-4164-ac6e-949ab7266308" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Lock "cinder-quobyte-21d897e0-ab9c-4164-ac6e-949ab7266308" acquired by "delete_volume" :: waited 0.013s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:55 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11397c9-58b2-4b7d-ad60-3b4269157bc4]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-21d897e0-ab9c-4164-ac6e-949ab7266308 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:56 devstack sudo[110534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-21d897e0-ab9c-4164-ac6e-949ab7266308
Apr 29 10:38:56 devstack sudo[110534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:56 devstack sudo[110534]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-21d897e0-ab9c-4164-ac6e-949ab7266308" returned: 0 in 0.689s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-21d897e0-ab9c-4164-ac6e-949ab7266308 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:56 devstack sudo[110539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-21d897e0-ab9c-4164-ac6e-949ab7266308
Apr 29 10:38:56 devstack sudo[110539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:57 devstack sudo[110539]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-21d897e0-ab9c-4164-ac6e-949ab7266308" returned: 0 in 0.574s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Lock "cinder-quobyte-21d897e0-ab9c-4164-ac6e-949ab7266308" released by "delete_volume" :: held 1.302s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:57 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Created reservations ['e0b66ed3-d723-4f79-a5ca-68cb1160583b', 'ddf6c292-a47c-46e4-ad62-c5ee961b3f9c', '042ca364-36e7-4636-adeb-da04ac79bf64', '2120046c-b0b8-4218-a498-48f1c3158c64'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:38:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:57 devstack sudo[110542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:38:57 devstack sudo[110542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:57 devstack sudo[110542]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.594s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:57 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:38:57 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Deleted volume successfully.
Apr 29 10:38:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-cf04279b-6b1a-4ab8-9aad-9c4d90a2e769 tempest-VolumesCloneTest-294771659 None] Lock "cinder-21d897e0-ab9c-4164-ac6e-949ab7266308-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Acquiring lock "cinder-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Lock "cinder-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Acquiring lock "cinder-quobyte-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:38:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Lock "cinder-quobyte-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9" acquired by "delete_volume" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:38:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a457f9d8-565c-4c7b-9be7-60cd78a58c07]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:38:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:58 devstack sudo[110545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9
Apr 29 10:38:58 devstack sudo[110545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:58 devstack sudo[110545]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9" returned: 0 in 0.699s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:58 devstack sudo[110550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9
Apr 29 10:38:58 devstack sudo[110550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:38:59 devstack sudo[110550]: pam_unix(sudo:session): session closed for user root
Apr 29 10:38:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9" returned: 0 in 0.578s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:38:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Lock "cinder-quobyte-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9" released by "delete_volume" :: held 1.334s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:38:59 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Created reservations ['85377660-1666-4d2d-ac4a-36788cf0e640', '31271f5d-24a4-44f4-adf6-db289b1b8a96', 'c10ce1e0-bc62-4e3a-8f39-913a8242d3e0', '121ec2b3-5d34-41c2-bd75-01d2098116b7'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:38:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:38:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:38:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:38:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:38:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:38:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:38:59 devstack sudo[110553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:38:59 devstack sudo[110553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:00 devstack sudo[110553]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.598s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:00 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:39:00 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Deleted volume successfully.
Apr 29 10:39:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4842a729-66af-4fe9-a255-7df972bb3013 tempest-VolumesCloneTest-294771659 None] Lock "cinder-70aaed57-a9ad-4a92-b6d1-6e30a7a45af9-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Flow 'volume_create_manager' (90d8e6d2-30a1-4177-9127-0d296ab75a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c421f30-504d-463c-8c49-72d5543b7356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c421f30-504d-463c-8c49-72d5543b7356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1968750183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a0802e-2a15-412d-b714-be143926a7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24cd8deeaea4456906e8c1b73831253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:03Z,use_quota=True,user_id='42d974addeab4e1ebff706e52465a870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc846f6d-e882-4b45-82be-403d35d406bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc846f6d-e882-4b45-82be-403d35d406bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fef1bcc-756b-41c6-b217-49b9cce1f40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fef1bcc-756b-41c6-b217-49b9cce1f40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a0802e-2a15-412d-b714-be143926a7cc', 'volume_name': 'volume-42a0802e-2a15-412d-b714-be143926a7cc', 'volume_size': 2}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4425911b-f09f-4ab7-8f38-66f991396470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4425911b-f09f-4ab7-8f38-66f991396470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7d5274-b702-4bb4-b230-23e84cdb30e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:03 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Volume 42a0802e-2a15-412d-b714-be143926a7cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a0802e-2a15-412d-b714-be143926a7cc', 'volume_size': 2}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1968750183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a0802e-2a15-412d-b714-be143926a7cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24cd8deeaea4456906e8c1b73831253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:03Z,use_quota=True,user_id='42d974addeab4e1ebff706e52465a870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Creating volume 42a0802e-2a15-412d-b714-be143926a7cc {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:39:03 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:39:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc 2147483648 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:03 devstack sudo[110557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc 2147483648
Apr 29 10:39:03 devstack sudo[110557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:04 devstack sudo[110557]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc 2147483648" returned: 0 in 0.847s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:04 devstack sudo[110564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc
Apr 29 10:39:04 devstack sudo[110564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:04 devstack sudo[110564]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc" returned: 0 in 0.578s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:39:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7d5274-b702-4bb4-b230-23e84cdb30e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a0802e-2a15-412d-b714-be143926a7cc', 'volume_size': 2}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35259ac3-85e1-4044-b85a-8f56601e56e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:04 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Volume volume-42a0802e-2a15-412d-b714-be143926a7cc (42a0802e-2a15-412d-b714-be143926a7cc): created successfully
Apr 29 10:39:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35259ac3-85e1-4044-b85a-8f56601e56e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:04 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Flow 'volume_create_manager' (90d8e6d2-30a1-4177-9127-0d296ab75a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:39:04 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c0f5d60d-d32d-4d36-bd15-9a265d08adab tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Created volume successfully.
Apr 29 10:39:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:39:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:39:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:39:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:05 devstack sudo[110567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:39:05 devstack sudo[110567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Creating offline snapshot 5fbaf9f5-1bf7-4582-bc8f-ae6621e70146 of volume 42a0802e-2a15-412d-b714-be143926a7cc {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:39:05 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ab31c6-0e6b-4a5f-a104-5bc8ab2d0420]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:39:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:05 devstack sudo[110569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc
Apr 29 10:39:05 devstack sudo[110569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:06 devstack sudo[110567]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.643s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:39:06 devstack sudo[110569]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc" returned: 0 in 0.701s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146 2G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:06 devstack sudo[110575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146 2G
Apr 29 10:39:06 devstack sudo[110575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:07 devstack sudo[110575]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146 2G" returned: 0 in 0.735s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42a0802e-2a15-412d-b714-be143926a7cc -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:07 devstack sudo[110581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42a0802e-2a15-412d-b714-be143926a7cc -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146
Apr 29 10:39:07 devstack sudo[110581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:07 devstack sudo[110581]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42a0802e-2a15-412d-b714-be143926a7cc -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146" returned: 0 in 0.632s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:07 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146 is being set with open permissions: ugo+rw
Apr 29 10:39:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:07 devstack sudo[110586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146
Apr 29 10:39:07 devstack sudo[110586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:08 devstack sudo[110586]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146" returned: 0 in 0.591s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:08 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=51,cinder:INSERT=27,cinder:UPDATE=72,cinder:DELETE=8 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:39:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:08 devstack sudo[110589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.info
Apr 29 10:39:08 devstack sudo[110589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:09 devstack sudo[110589]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.info" returned: 0 in 0.660s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:09 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.info is being set with open permissions: ugo+rw
Apr 29 10:39:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:09 devstack sudo[110592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.info
Apr 29 10:39:09 devstack sudo[110592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:09 devstack sudo[110592]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.info" returned: 0 in 0.657s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.084s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:09 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-53087e10-5efd-48f5-945c-2915c28b2573 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Create snapshot completed successfully
Apr 29 10:39:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Acquiring lock "cinder-5fbaf9f5-1bf7-4582-bc8f-ae6621e70146-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "cinder-5fbaf9f5-1bf7-4582-bc8f-ae6621e70146-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Acquiring lock "cinder-quobyte-42a0802e-2a15-412d-b714-be143926a7cc" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "cinder-quobyte-42a0802e-2a15-412d-b714-be143926a7cc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Acquiring lock "cinder-quobyte-5fbaf9f5-1bf7-4582-bc8f-ae6621e70146" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "cinder-quobyte-5fbaf9f5-1bf7-4582-bc8f-ae6621e70146" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Deleting offline snapshot 5fbaf9f5-1bf7-4582-bc8f-ae6621e70146 of volume 42a0802e-2a15-412d-b714-be143926a7cc {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:39:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] snapshot_file for this snap is: volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:39:11 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fec5198-fe23-4fb5-8dc6-889ccb322d9b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:39:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:11 devstack sudo[110595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146
Apr 29 10:39:11 devstack sudo[110595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:11 devstack sudo[110595]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146" returned: 0 in 0.743s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:11 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42a0802e-2a15-412d-b714-be143926a7cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:39:11 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcd05ea-2664-4731-ab3c-af5805494d60]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:39:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:11 devstack sudo[110600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc
Apr 29 10:39:11 devstack sudo[110600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:12 devstack sudo[110600]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc" returned: 0 in 0.692s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:12 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:12 devstack sudo[110605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146
Apr 29 10:39:12 devstack sudo[110605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:13 devstack sudo[110605]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146" returned: 0 in 0.682s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:13 devstack sudo[110611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146
Apr 29 10:39:13 devstack sudo[110611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:13 devstack sudo[110611]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:13 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc.5fbaf9f5-1bf7-4582-bc8f-ae6621e70146" returned: 0 in 0.598s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:13 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "cinder-quobyte-5fbaf9f5-1bf7-4582-bc8f-ae6621e70146" released by "_delete_snapshot" :: held 2.822s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:13 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "cinder-quobyte-42a0802e-2a15-412d-b714-be143926a7cc" released by "delete_snapshot" :: held 2.852s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:13 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Created reservations ['8ddc10a0-3a44-4719-8fa7-fde973a998b8', 'f15daa13-8a90-4230-b93c-48a0b86e84ee', '02336a39-92a1-4434-9ca5-501114d916fd', '43c66330-91ae-4e7f-ab06-450c7ed9083a'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:39:13 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Delete snapshot completed successfully.
Apr 29 10:39:13 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-739fd3d9-36fa-42a3-bfbb-9550b0a8ca07 tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "cinder-5fbaf9f5-1bf7-4582-bc8f-ae6621e70146-delete_snapshot" released by "delete_snapshot" :: held 2.986s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Acquiring lock "cinder-42a0802e-2a15-412d-b714-be143926a7cc-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "cinder-42a0802e-2a15-412d-b714-be143926a7cc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Acquiring lock "cinder-quobyte-42a0802e-2a15-412d-b714-be143926a7cc" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:14 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "cinder-quobyte-42a0802e-2a15-412d-b714-be143926a7cc" acquired by "delete_volume" :: waited 0.013s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:14 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0058913f-c07d-4e53-9339-d91bd2e54f08]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:39:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:14 devstack sudo[110615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc
Apr 29 10:39:14 devstack sudo[110615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:14 devstack sudo[110615]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc" returned: 0 in 0.691s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:14 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:15 devstack sudo[110620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc
Apr 29 10:39:15 devstack sudo[110620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:15 devstack sudo[110620]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-42a0802e-2a15-412d-b714-be143926a7cc" returned: 0 in 0.577s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:15 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "cinder-quobyte-42a0802e-2a15-412d-b714-be143926a7cc" released by "delete_volume" :: held 1.325s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:15 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Created reservations ['bc339526-9efa-416a-94d6-bed2eee5b700', '3e672b2c-ea1d-4097-ae37-ac427ed68e35', 'bda0b200-c0f4-4250-8196-fb6e7d278639', 'e188f188-8290-432b-a40b-a1cecab8037d'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:39:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:39:15 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:39:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:15 devstack sudo[110623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:39:15 devstack sudo[110623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:16 devstack sudo[110623]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.572s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:16 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:39:16 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Deleted volume successfully.
Apr 29 10:39:16 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-fe41aad4-854e-4261-aa03-2a5f977b328d tempest-VolumesSnapshotNegativeTestJSON-2031519530 None] Lock "cinder-42a0802e-2a15-412d-b714-be143926a7cc-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Flow 'volume_create_manager' (551541fa-ed81-4436-bb33-97712e54d04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581e9bae-647b-4018-9307-d307f31ccfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581e9bae-647b-4018-9307-d307f31ccfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1787878133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41aaf25e-5584-4ca7-9d7a-34b48eae1a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e39ac018525458aa9d51a2e3dbcc532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:19Z,use_quota=True,user_id='3a5609bb124c48dd81a9ba36ad84817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c858d6-1450-4891-9f6d-e00b1f5982bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c858d6-1450-4891-9f6d-e00b1f5982bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144c4be0-89f3-498c-a26c-c9561afdfb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144c4be0-89f3-498c-a26c-c9561afdfb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41aaf25e-5584-4ca7-9d7a-34b48eae1a08', 'volume_name': 'volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc659f08-24dd-43c5-944a-10785e46fc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc659f08-24dd-43c5-944a-10785e46fc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a529d86-e07c-4626-8b2c-93496416ca3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:18 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume 41aaf25e-5584-4ca7-9d7a-34b48eae1a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08', 'volume_size': 1}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1787878133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41aaf25e-5584-4ca7-9d7a-34b48eae1a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e39ac018525458aa9d51a2e3dbcc532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:19Z,use_quota=True,user_id='3a5609bb124c48dd81a9ba36ad84817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Creating volume 41aaf25e-5584-4ca7-9d7a-34b48eae1a08 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:39:18 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:39:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:18 devstack sudo[110626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08 1073741824
Apr 29 10:39:18 devstack sudo[110626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:19 devstack sudo[110626]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08 1073741824" returned: 0 in 0.750s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:19 devstack sudo[110631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08
Apr 29 10:39:19 devstack sudo[110631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:20 devstack sudo[110631]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08" returned: 0 in 0.589s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:20 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:39:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a529d86-e07c-4626-8b2c-93496416ca3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d52964db-c642-4620-9628-ec9bda41fe4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:20 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08 (41aaf25e-5584-4ca7-9d7a-34b48eae1a08): created successfully
Apr 29 10:39:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d52964db-c642-4620-9628-ec9bda41fe4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Flow 'volume_create_manager' (551541fa-ed81-4436-bb33-97712e54d04b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:39:20 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5e61b734-82d5-482f-bad8-94b69447dab1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Created volume successfully.
Apr 29 10:39:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Creating offline snapshot 70776911-0e0a-4045-8234-0c713285e997 of volume 41aaf25e-5584-4ca7-9d7a-34b48eae1a08 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:39:21 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bf5b63-9c7c-4aac-a11d-b76f0cd24211]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:39:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:21 devstack sudo[110634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08
Apr 29 10:39:21 devstack sudo[110634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:21 devstack sudo[110634]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08" returned: 0 in 0.708s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:21 devstack sudo[110639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997 1G
Apr 29 10:39:21 devstack sudo[110639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:22 devstack sudo[110639]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997 1G" returned: 0 in 0.752s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:22 devstack sudo[110650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997
Apr 29 10:39:22 devstack sudo[110650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:23 devstack sudo[110650]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997" returned: 0 in 0.643s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:23 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997 is being set with open permissions: ugo+rw
Apr 29 10:39:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:23 devstack sudo[110655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997
Apr 29 10:39:23 devstack sudo[110655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:23 devstack sudo[110655]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997" returned: 0 in 0.558s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:23 devstack sudo[110659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.info
Apr 29 10:39:23 devstack sudo[110659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:24 devstack sudo[110659]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.info" returned: 0 in 0.606s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:24 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.info is being set with open permissions: ugo+rw
Apr 29 10:39:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:24 devstack sudo[110663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.info
Apr 29 10:39:24 devstack sudo[110663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:25 devstack sudo[110663]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.info" returned: 0 in 0.570s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.927s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:25 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-cd199dae-d3ee-49db-b1e0-f4ce7b711d15 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Create snapshot completed successfully
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Flow 'volume_create_manager' (638c7c31-4d24-40ad-ba76-d9cd06f8d829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78882c2-8e2a-4f7e-a803-4dc000322265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78882c2-8e2a-4f7e-a803-4dc000322265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1403617188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ebda9d-a1d7-4662-9161-4a9dbadf9b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e39ac018525458aa9d51a2e3dbcc532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:26Z,use_quota=True,user_id='3a5609bb124c48dd81a9ba36ad84817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1106f5d0-e8e1-4361-9d80-df0c051fd930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1106f5d0-e8e1-4361-9d80-df0c051fd930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70777ed2-a63a-4bb0-a8c3-6ee7c0630721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70777ed2-a63a-4bb0-a8c3-6ee7c0630721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ebda9d-a1d7-4662-9161-4a9dbadf9b99', 'volume_name': 'volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b565eccd-cf33-4773-864a-850a02f49e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b565eccd-cf33-4773-864a-850a02f49e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d339cc24-ecc5-4609-a7be-9c2ee99f0d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:25 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume 75ebda9d-a1d7-4662-9161-4a9dbadf9b99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99', 'volume_size': 1}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1403617188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ebda9d-a1d7-4662-9161-4a9dbadf9b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e39ac018525458aa9d51a2e3dbcc532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:26Z,use_quota=True,user_id='3a5609bb124c48dd81a9ba36ad84817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Creating volume 75ebda9d-a1d7-4662-9161-4a9dbadf9b99 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:39:25 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:25 devstack sudo[110666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99 1073741824
Apr 29 10:39:25 devstack sudo[110666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Flow 'volume_create_manager' (9bef715b-c086-43e1-84e0-790f3318eaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8774d0-56ed-4f3f-9ee8-2c6e55d0ad2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8774d0-56ed-4f3f-9ee8-2c6e55d0ad2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1691074369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e10de82-71ea-4302-91fc-c3c3c24a79b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e39ac018525458aa9d51a2e3dbcc532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:26Z,use_quota=True,user_id='3a5609bb124c48dd81a9ba36ad84817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3658936-c508-47f4-89db-41287a2cc722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3658936-c508-47f4-89db-41287a2cc722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce69aa9-b5f2-4b0e-8e1c-d67b19c6ffb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce69aa9-b5f2-4b0e-8e1c-d67b19c6ffb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e10de82-71ea-4302-91fc-c3c3c24a79b4', 'volume_name': 'volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42ceed5-01f3-4930-a435-254acef39385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42ceed5-01f3-4930-a435-254acef39385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d9cee9-f89a-49d3-9651-4307140375f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:26 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume 9e10de82-71ea-4302-91fc-c3c3c24a79b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4', 'volume_size': 1}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Flow 'volume_create_manager' (65b902d4-a5c1-44c6-a0f0-d20e0f22c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5938c04f-81b6-49dd-9da7-48ed8f38c30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5938c04f-81b6-49dd-9da7-48ed8f38c30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-538706220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d22c0b-6835-4c47-81a6-7fba7f59a277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e39ac018525458aa9d51a2e3dbcc532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:26Z,use_quota=True,user_id='3a5609bb124c48dd81a9ba36ad84817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103f10ea-577e-41d7-9c61-0f4aaf6555c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103f10ea-577e-41d7-9c61-0f4aaf6555c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1403d8aa-4538-4ec5-9883-37238f4af860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1403d8aa-4538-4ec5-9883-37238f4af860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2d22c0b-6835-4c47-81a6-7fba7f59a277', 'volume_name': 'volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ac2d94-c388-470b-8e33-72ee63f81388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ac2d94-c388-470b-8e33-72ee63f81388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439934e5-8093-4064-a693-8019f7fcfe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:26 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume e2d22c0b-6835-4c47-81a6-7fba7f59a277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277', 'volume_size': 1}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:26 devstack sudo[110666]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Flow 'volume_create_manager' (c8487ec0-e801-40d1-bc16-71989fddc43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda07d5f-4e30-4001-8659-04a36c226a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99 1073741824" returned: 0 in 0.958s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda07d5f-4e30-4001-8659-04a36c226a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1754600604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab033538-04c9-41c3-bfb5-2ff9f01c1907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e39ac018525458aa9d51a2e3dbcc532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:27Z,use_quota=True,user_id='3a5609bb124c48dd81a9ba36ad84817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105e26a2-e276-4fa9-b45d-fc45b23bf093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105e26a2-e276-4fa9-b45d-fc45b23bf093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9e0ef0-862c-41f7-9c3c-63f0e3d9731b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9e0ef0-862c-41f7-9c3c-63f0e3d9731b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab033538-04c9-41c3-bfb5-2ff9f01c1907', 'volume_name': 'volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8774deac-0ad6-4ad3-a7cb-41401cb41754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8774deac-0ad6-4ad3-a7cb-41401cb41754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06dcb5d-7ff7-43cd-a0d0-8caffd37d71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:26 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume ab033538-04c9-41c3-bfb5-2ff9f01c1907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907', 'volume_size': 1}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:26 devstack sudo[110672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99
Apr 29 10:39:26 devstack sudo[110672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:26 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Flow 'volume_create_manager' (7d450ce2-5f9f-4adc-a8e9-82fba5cf0412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b2c1c0-985a-4a0f-ba75-7fa9500c2408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b2c1c0-985a-4a0f-ba75-7fa9500c2408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744231124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d6e857-d221-460d-b2f9-9d8291bc520c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e39ac018525458aa9d51a2e3dbcc532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:27Z,use_quota=True,user_id='3a5609bb124c48dd81a9ba36ad84817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d2d5e3-5520-464a-a7f2-ce0312732273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d2d5e3-5520-464a-a7f2-ce0312732273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c342325f-6d29-4a7a-b85e-75132a5474ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c342325f-6d29-4a7a-b85e-75132a5474ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12d6e857-d221-460d-b2f9-9d8291bc520c', 'volume_name': 'volume-12d6e857-d221-460d-b2f9-9d8291bc520c', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7a4705-1f1c-4baf-960f-ef937bf2dc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7a4705-1f1c-4baf-960f-ef937bf2dc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea18b788-7a75-4e6a-ac9f-40f6dcabfa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:27 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume 12d6e857-d221-460d-b2f9-9d8291bc520c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12d6e857-d221-460d-b2f9-9d8291bc520c', 'volume_size': 1}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:27 devstack sudo[110672]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99" returned: 0 in 0.663s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.357s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1691074369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e10de82-71ea-4302-91fc-c3c3c24a79b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e39ac018525458aa9d51a2e3dbcc532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:26Z,use_quota=True,user_id='3a5609bb124c48dd81a9ba36ad84817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Creating volume 9e10de82-71ea-4302-91fc-c3c3c24a79b4 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:39:27 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d339cc24-ecc5-4609-a7be-9c2ee99f0d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:27 devstack sudo[110678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4 1073741824
Apr 29 10:39:27 devstack sudo[110678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0555a7d-2666-49dc-b13b-52c2acbb9693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:27 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99 (75ebda9d-a1d7-4662-9161-4a9dbadf9b99): created successfully
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0555a7d-2666-49dc-b13b-52c2acbb9693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Flow 'volume_create_manager' (638c7c31-4d24-40ad-ba76-d9cd06f8d829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:39:27 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-90351ae7-a963-4aab-af72-0150eda4f1ad tempest-CreateVolumesFromSnapshotTest-1293197310 None] Created volume successfully.
Apr 29 10:39:28 devstack sudo[110678]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4 1073741824" returned: 0 in 0.795s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:28 devstack sudo[110721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4
Apr 29 10:39:28 devstack sudo[110721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:28 devstack sudo[110721]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4" returned: 0 in 0.594s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.471s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-538706220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d22c0b-6835-4c47-81a6-7fba7f59a277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e39ac018525458aa9d51a2e3dbcc532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:26Z,use_quota=True,user_id='3a5609bb124c48dd81a9ba36ad84817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Creating volume e2d22c0b-6835-4c47-81a6-7fba7f59a277 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:39:28 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:28 devstack sudo[110724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277 1073741824
Apr 29 10:39:28 devstack sudo[110724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d9cee9-f89a-49d3-9651-4307140375f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b401d289-6d0b-4d83-8bda-40e181675426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:28 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4 (9e10de82-71ea-4302-91fc-c3c3c24a79b4): created successfully
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b401d289-6d0b-4d83-8bda-40e181675426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:28 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Flow 'volume_create_manager' (9bef715b-c086-43e1-84e0-790f3318eaeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:39:28 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-9161b0e6-b5b0-4c85-bf06-6528f128472f tempest-CreateVolumesFromSnapshotTest-1293197310 None] Created volume successfully.
Apr 29 10:39:29 devstack sudo[110724]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277 1073741824" returned: 0 in 0.821s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:29 devstack sudo[110729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277
Apr 29 10:39:29 devstack sudo[110729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:30 devstack sudo[110729]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277" returned: 0 in 0.608s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.601s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1754600604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab033538-04c9-41c3-bfb5-2ff9f01c1907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e39ac018525458aa9d51a2e3dbcc532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:27Z,use_quota=True,user_id='3a5609bb124c48dd81a9ba36ad84817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Creating volume ab033538-04c9-41c3-bfb5-2ff9f01c1907 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:39:30 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439934e5-8093-4064-a693-8019f7fcfe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ba6cec-f6a7-4417-8196-4360cfef37a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:30 devstack sudo[110732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907 1073741824
Apr 29 10:39:30 devstack sudo[110732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:30 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277 (e2d22c0b-6835-4c47-81a6-7fba7f59a277): created successfully
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ba6cec-f6a7-4417-8196-4360cfef37a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Flow 'volume_create_manager' (65b902d4-a5c1-44c6-a0f0-d20e0f22c752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:39:30 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a1ef04d0-70c2-47fc-b976-fc53c20bd7c4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Created volume successfully.
Apr 29 10:39:31 devstack sudo[110732]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907 1073741824" returned: 0 in 0.767s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:31 devstack sudo[110737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907
Apr 29 10:39:31 devstack sudo[110737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:31 devstack sudo[110737]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907" returned: 0 in 0.589s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.632s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744231124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d6e857-d221-460d-b2f9-9d8291bc520c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e39ac018525458aa9d51a2e3dbcc532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:27Z,use_quota=True,user_id='3a5609bb124c48dd81a9ba36ad84817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Creating volume 12d6e857-d221-460d-b2f9-9d8291bc520c {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:39:31 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-12d6e857-d221-460d-b2f9-9d8291bc520c 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:31 devstack sudo[110741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-12d6e857-d221-460d-b2f9-9d8291bc520c 1073741824
Apr 29 10:39:31 devstack sudo[110741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06dcb5d-7ff7-43cd-a0d0-8caffd37d71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8936c505-33bc-48ef-a2cf-2fea90891628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:31 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907 (ab033538-04c9-41c3-bfb5-2ff9f01c1907): created successfully
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8936c505-33bc-48ef-a2cf-2fea90891628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:31 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Flow 'volume_create_manager' (c8487ec0-e801-40d1-bc16-71989fddc43d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:39:31 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-fa98de82-1192-4deb-a95b-93bc88b4eec1 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Created volume successfully.
Apr 29 10:39:32 devstack sudo[110741]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-12d6e857-d221-460d-b2f9-9d8291bc520c 1073741824" returned: 0 in 0.809s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-12d6e857-d221-460d-b2f9-9d8291bc520c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:32 devstack sudo[110747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-12d6e857-d221-460d-b2f9-9d8291bc520c
Apr 29 10:39:32 devstack sudo[110747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:33 devstack sudo[110747]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-12d6e857-d221-460d-b2f9-9d8291bc520c" returned: 0 in 0.621s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:33 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:39:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea18b788-7a75-4e6a-ac9f-40f6dcabfa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12d6e857-d221-460d-b2f9-9d8291bc520c', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e793c7e1-c87b-4dd3-b144-be73691adfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:39:33 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Volume volume-12d6e857-d221-460d-b2f9-9d8291bc520c (12d6e857-d221-460d-b2f9-9d8291bc520c): created successfully
Apr 29 10:39:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e793c7e1-c87b-4dd3-b144-be73691adfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:39:33 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Flow 'volume_create_manager' (7d450ce2-5f9f-4adc-a8e9-82fba5cf0412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:39:33 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-26889e09-516a-4188-8c1a-811da0817cba tempest-CreateVolumesFromSnapshotTest-1293197310 None] Created volume successfully.
Apr 29 10:39:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "cinder-12d6e857-d221-460d-b2f9-9d8291bc520c-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-12d6e857-d221-460d-b2f9-9d8291bc520c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "cinder-quobyte-12d6e857-d221-460d-b2f9-9d8291bc520c" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-12d6e857-d221-460d-b2f9-9d8291bc520c" acquired by "delete_volume" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:33 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e802d2-106b-4ad8-87d8-cc11b8f71a17]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:39:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-12d6e857-d221-460d-b2f9-9d8291bc520c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:33 devstack sudo[110750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-12d6e857-d221-460d-b2f9-9d8291bc520c
Apr 29 10:39:33 devstack sudo[110750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:34 devstack sudo[110750]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-12d6e857-d221-460d-b2f9-9d8291bc520c" returned: 0 in 0.728s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-12d6e857-d221-460d-b2f9-9d8291bc520c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:34 devstack sudo[110756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-12d6e857-d221-460d-b2f9-9d8291bc520c
Apr 29 10:39:34 devstack sudo[110756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:35 devstack sudo[110756]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-12d6e857-d221-460d-b2f9-9d8291bc520c" returned: 0 in 0.609s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-12d6e857-d221-460d-b2f9-9d8291bc520c" released by "delete_volume" :: held 1.376s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Created reservations ['f0b068da-8998-4fb0-952d-2b6626a74052', 'bd24b111-a288-491d-8c6b-8bc6a94c93d9', 'e481a783-737a-4a18-ba72-76718be9ce18', '7964d703-c24e-46a3-b6f2-153ac4d21d4d'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:35 devstack sudo[110759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:39:35 devstack sudo[110759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:35 devstack sudo[110759]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.614s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:39:35 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Deleted volume successfully.
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1e68d6e5-f7a6-4084-82cb-d5c86c1e34e5 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-12d6e857-d221-460d-b2f9-9d8291bc520c-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "cinder-ab033538-04c9-41c3-bfb5-2ff9f01c1907-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-ab033538-04c9-41c3-bfb5-2ff9f01c1907-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "cinder-quobyte-ab033538-04c9-41c3-bfb5-2ff9f01c1907" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-ab033538-04c9-41c3-bfb5-2ff9f01c1907" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c737055-385d-493b-95c4-99639b79d6d8]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:39:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:36 devstack sudo[110762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907
Apr 29 10:39:36 devstack sudo[110762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:36 devstack sudo[110762]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907" returned: 0 in 0.704s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:36 devstack sudo[110767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907
Apr 29 10:39:36 devstack sudo[110767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:37 devstack sudo[110767]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-ab033538-04c9-41c3-bfb5-2ff9f01c1907" returned: 0 in 0.578s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:37 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-ab033538-04c9-41c3-bfb5-2ff9f01c1907" released by "delete_volume" :: held 1.318s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:37 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Created reservations ['c5405851-9432-47e0-8921-dd0d30e7b19b', 'e8be12d1-61d6-4664-9163-6cd031821993', '8e464bfc-491d-4e83-90c9-0aaf583f60ac', 'c605c548-603d-4933-b0a7-2475ba47a2e5'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:39:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:39:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:39:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:37 devstack sudo[110770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:39:37 devstack sudo[110770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "cinder-e2d22c0b-6835-4c47-81a6-7fba7f59a277-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-e2d22c0b-6835-4c47-81a6-7fba7f59a277-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:38 devstack sudo[110770]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.570s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:38 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:39:38 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Deleted volume successfully.
Apr 29 10:39:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "cinder-quobyte-e2d22c0b-6835-4c47-81a6-7fba7f59a277" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f4fa170b-4de8-4d8e-8040-0607355485ee tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-ab033538-04c9-41c3-bfb5-2ff9f01c1907-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-e2d22c0b-6835-4c47-81a6-7fba7f59a277" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:38 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28e8e8c-d77a-46d7-9a58-50e1fc7c85ea]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:39:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:38 devstack sudo[110773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277
Apr 29 10:39:38 devstack sudo[110773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:38 devstack sudo[110773]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277" returned: 0 in 0.718s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:38 devstack sudo[110778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277
Apr 29 10:39:38 devstack sudo[110778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:39 devstack sudo[110778]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-e2d22c0b-6835-4c47-81a6-7fba7f59a277" returned: 0 in 0.573s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:39 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-e2d22c0b-6835-4c47-81a6-7fba7f59a277" released by "delete_volume" :: held 1.330s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:39 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Created reservations ['116a9fac-0a8d-45bf-a339-6e838e895203', '9c7e0063-be06-4bac-b3d0-38d2c0ebdee9', '5711f477-c1c4-45f5-b66e-3c6e5bd77b3c', '584803b8-1935-424d-b334-d7afc67e2751'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:39:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:39:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:39:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:39 devstack sudo[110781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:39:39 devstack sudo[110781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:40 devstack sudo[110781]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.597s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:40 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:39:40 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Deleted volume successfully.
Apr 29 10:39:40 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0d1da5e7-0f9c-4a96-8a14-f9e8453f39a4 tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-e2d22c0b-6835-4c47-81a6-7fba7f59a277-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:40 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "cinder-9e10de82-71ea-4302-91fc-c3c3c24a79b4-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:40 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-9e10de82-71ea-4302-91fc-c3c3c24a79b4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:40 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "cinder-quobyte-9e10de82-71ea-4302-91fc-c3c3c24a79b4" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:40 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-9e10de82-71ea-4302-91fc-c3c3c24a79b4" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:40 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2400be6-9390-4b9f-9026-2a5f456753b4]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:39:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:40 devstack sudo[110784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4
Apr 29 10:39:40 devstack sudo[110784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:41 devstack sudo[110784]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4" returned: 0 in 0.774s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:41 devstack sudo[110791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4
Apr 29 10:39:41 devstack sudo[110791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:41 devstack sudo[110791]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9e10de82-71ea-4302-91fc-c3c3c24a79b4" returned: 0 in 0.582s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-9e10de82-71ea-4302-91fc-c3c3c24a79b4" released by "delete_volume" :: held 1.397s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:41 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Created reservations ['7eb0bb65-6f96-41c5-b247-ba56a74cb38a', 'b8404ea6-450b-408b-9e1c-dc762533c441', '92b57e81-3033-4629-a8ac-c9d84176e9de', 'ff8ee68d-61ed-4d49-8b42-39ffecb39041'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:39:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:39:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:39:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:42 devstack sudo[110794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:39:42 devstack sudo[110794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:42 devstack sudo[110794]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.594s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:42 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:39:42 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Deleted volume successfully.
Apr 29 10:39:42 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dfa570c9-f23d-4c53-b451-a5f0dafae4bb tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-9e10de82-71ea-4302-91fc-c3c3c24a79b4-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:42 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "cinder-75ebda9d-a1d7-4662-9161-4a9dbadf9b99-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:42 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-75ebda9d-a1d7-4662-9161-4a9dbadf9b99-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:42 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "cinder-quobyte-75ebda9d-a1d7-4662-9161-4a9dbadf9b99" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:42 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-75ebda9d-a1d7-4662-9161-4a9dbadf9b99" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:42 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a4aa81-a349-4657-b8f0-488854c721f4]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:39:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:42 devstack sudo[110797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99
Apr 29 10:39:42 devstack sudo[110797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:43 devstack sudo[110797]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99" returned: 0 in 0.697s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:43 devstack sudo[110802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99
Apr 29 10:39:43 devstack sudo[110802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:44 devstack sudo[110802]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-75ebda9d-a1d7-4662-9161-4a9dbadf9b99" returned: 0 in 0.588s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-75ebda9d-a1d7-4662-9161-4a9dbadf9b99" released by "delete_volume" :: held 1.326s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Created reservations ['bd04bc3e-a6eb-48f7-aa40-767bcae25f28', '20dabfaf-fcce-4886-ad43-72385029d043', '4bcb45db-ac57-4183-b5de-c41d20a0194e', '3f42d33a-068e-4f4a-a46a-018d945e6356'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:44 devstack sudo[110806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:39:44 devstack sudo[110806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:44 devstack sudo[110806]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.559s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:39:44 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Deleted volume successfully.
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4c68650f-72c1-47d4-a0be-2c908c51a27a tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-75ebda9d-a1d7-4662-9161-4a9dbadf9b99-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "cinder-70776911-0e0a-4045-8234-0c713285e997-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-70776911-0e0a-4045-8234-0c713285e997-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "cinder-quobyte-41aaf25e-5584-4ca7-9d7a-34b48eae1a08" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-41aaf25e-5584-4ca7-9d7a-34b48eae1a08" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "cinder-quobyte-70776911-0e0a-4045-8234-0c713285e997" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-70776911-0e0a-4045-8234-0c713285e997" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Deleting offline snapshot 70776911-0e0a-4045-8234-0c713285e997 of volume 41aaf25e-5584-4ca7-9d7a-34b48eae1a08 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] snapshot_file for this snap is: volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2171b95e-eb0b-4862-a088-ce391fd23894]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:39:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:45 devstack sudo[110809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997
Apr 29 10:39:45 devstack sudo[110809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:45 devstack sudo[110809]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997" returned: 0 in 0.719s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:39:45 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f1e231-3b54-4afe-8118-583f492f695e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:39:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:45 devstack sudo[110814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08
Apr 29 10:39:45 devstack sudo[110814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:46 devstack sudo[110814]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08" returned: 0 in 0.676s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:46 devstack sudo[110819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997
Apr 29 10:39:46 devstack sudo[110819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:47 devstack sudo[110819]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997" returned: 0 in 0.704s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:47 devstack sudo[110824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997
Apr 29 10:39:47 devstack sudo[110824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:47 devstack sudo[110824]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08.70776911-0e0a-4045-8234-0c713285e997" returned: 0 in 0.553s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-70776911-0e0a-4045-8234-0c713285e997" released by "_delete_snapshot" :: held 2.749s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-41aaf25e-5584-4ca7-9d7a-34b48eae1a08" released by "delete_snapshot" :: held 2.770s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:47 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Created reservations ['21b82aab-0fb2-40bc-9dda-f0b6cf68a5e1', '79575649-4274-4d62-99f5-be3cf6df0259', '2da6ddb5-a41b-4694-af40-7b0e7620e33d', '0f2385f6-8d67-4fd4-a22d-003fff3ae793'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:39:47 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Delete snapshot completed successfully.
Apr 29 10:39:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-34896232-9957-4c60-9b69-190f0fba384c tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-70776911-0e0a-4045-8234-0c713285e997-delete_snapshot" released by "delete_snapshot" :: held 2.900s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "cinder-41aaf25e-5584-4ca7-9d7a-34b48eae1a08-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-41aaf25e-5584-4ca7-9d7a-34b48eae1a08-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "cinder-quobyte-41aaf25e-5584-4ca7-9d7a-34b48eae1a08" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:39:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-41aaf25e-5584-4ca7-9d7a-34b48eae1a08" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:39:48 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb075b81-2831-404b-bac2-a3313367d87a]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:39:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:48 devstack sudo[110827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08
Apr 29 10:39:48 devstack sudo[110827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:48 devstack sudo[110827]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08" returned: 0 in 0.684s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:48 devstack sudo[110832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08
Apr 29 10:39:48 devstack sudo[110832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:49 devstack sudo[110832]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-41aaf25e-5584-4ca7-9d7a-34b48eae1a08" returned: 0 in 0.564s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-quobyte-41aaf25e-5584-4ca7-9d7a-34b48eae1a08" released by "delete_volume" :: held 1.302s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:49 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Created reservations ['46c56212-6063-4f91-a041-8db064739e7e', '15e226c3-2a19-4545-99e7-2c6003002629', 'a13743c6-7305-4562-aa74-ad05e9a4aa21', '40068da2-753e-4bc7-9944-774f67e7afdb'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:39:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:39:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:39:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:39:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:39:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:39:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:39:49 devstack sudo[110835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:39:49 devstack sudo[110835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:39:50 devstack sudo[110835]: pam_unix(sudo:session): session closed for user root
Apr 29 10:39:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.569s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:39:50 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:39:50 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Deleted volume successfully.
Apr 29 10:39:50 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4c491116-ef5c-4423-83ab-9a946fea637b tempest-CreateVolumesFromSnapshotTest-1293197310 None] Lock "cinder-41aaf25e-5584-4ca7-9d7a-34b48eae1a08-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:39:59 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=91,cinder:UPDATE=103,cinder:DELETE=6,cinder:INSERT=25 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:40:00 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=95,cinder:DELETE=11,cinder:SELECT=53,cinder:INSERT=23 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:40:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:40:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:40:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:40:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:40:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:40:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:40:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:40:05 devstack sudo[110844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:40:05 devstack sudo[110844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:40:06 devstack sudo[110844]: pam_unix(sudo:session): session closed for user root
Apr 29 10:40:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.576s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:40:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:41:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:41:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:41:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:41:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:41:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:41:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:41:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:41:05 devstack sudo[110900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:41:05 devstack sudo[110900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:41:06 devstack sudo[110900]: pam_unix(sudo:session): session closed for user root
Apr 29 10:41:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.561s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:41:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:41:20 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:41:20 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:42:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:42:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:42:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:42:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:42:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:42:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:42:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:42:05 devstack sudo[110955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:42:05 devstack sudo[110955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:42:06 devstack sudo[110955]: pam_unix(sudo:session): session closed for user root
Apr 29 10:42:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.623s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:42:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:43:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:43:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:43:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:43:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:43:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:43:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:43:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:43:05 devstack sudo[111011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:43:05 devstack sudo[111011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:43:06 devstack sudo[111011]: pam_unix(sudo:session): session closed for user root
Apr 29 10:43:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.589s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:43:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:43:20 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:43:20 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:44:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:44:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:44:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:44:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:44:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:44:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:44:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:44:05 devstack sudo[111068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:44:05 devstack sudo[111068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:44:06 devstack sudo[111068]: pam_unix(sudo:session): session closed for user root
Apr 29 10:44:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.578s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:44:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:45:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:45:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:45:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:45:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:45:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:45:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:45:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:05 devstack sudo[111126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:45:05 devstack sudo[111126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:06 devstack sudo[111126]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.563s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:45:20 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:45:20 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=1 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Flow 'volume_create_manager' (506a8d9f-1612-49db-8cf7-000296133856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e420da5-7ca1-4038-9139-ce5e7b938dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e420da5-7ca1-4038-9139-ce5e7b938dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1702098596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c738e95-93d4-4811-8aa2-bf5e5287cea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d243c4123d54bd0acff7d9f0335d972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:45:37Z,use_quota=True,user_id='16d50f72fd2a4ccead3c48c13f54701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af556c5-962d-4b85-a2f0-65695ac2c507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af556c5-962d-4b85-a2f0-65695ac2c507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e108c00-794d-4d0d-b5bb-f7e6d74f3b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e108c00-794d-4d0d-b5bb-f7e6d74f3b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c738e95-93d4-4811-8aa2-bf5e5287cea8', 'volume_name': 'volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fd0830-17af-4b50-a0f5-83703596063f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fd0830-17af-4b50-a0f5-83703596063f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4696ce-00ae-45fd-8dc0-6613343cb9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:45:37 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Volume 5c738e95-93d4-4811-8aa2-bf5e5287cea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8', 'volume_size': 1}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1702098596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c738e95-93d4-4811-8aa2-bf5e5287cea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d243c4123d54bd0acff7d9f0335d972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:45:37Z,use_quota=True,user_id='16d50f72fd2a4ccead3c48c13f54701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Creating volume 5c738e95-93d4-4811-8aa2-bf5e5287cea8 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:45:37 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:37 devstack sudo[111185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 1073741824
Apr 29 10:45:37 devstack sudo[111185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:37 devstack sudo[111185]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 1073741824" returned: 0 in 0.795s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:38 devstack sudo[111190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8
Apr 29 10:45:38 devstack sudo[111190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:38 devstack sudo[111190]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8" returned: 0 in 0.574s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:38 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:45:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:45:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4696ce-00ae-45fd-8dc0-6613343cb9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:45:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142bb473-7165-408b-8cb7-cc4a202f8a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:45:38 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Volume volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 (5c738e95-93d4-4811-8aa2-bf5e5287cea8): created successfully
Apr 29 10:45:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142bb473-7165-408b-8cb7-cc4a202f8a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:45:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Flow 'volume_create_manager' (506a8d9f-1612-49db-8cf7-000296133856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:45:38 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5a04dcc1-719a-465e-bbb6-e363844668ba tempest-SnapshotDependencyTests-936320387 None] Created volume successfully.
Apr 29 10:45:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:45:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:45:39 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] Creating offline snapshot 7478cd51-0dfd-45f4-a71a-b01bcca99569 of volume 5c738e95-93d4-4811-8aa2-bf5e5287cea8 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:45:39 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d46b13-f9f9-40d8-a898-265fe281e5cb]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:45:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:39 devstack sudo[111193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8
Apr 29 10:45:39 devstack sudo[111193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:40 devstack sudo[111193]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8" returned: 0 in 0.709s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:40 devstack sudo[111198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569 1G
Apr 29 10:45:40 devstack sudo[111198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:40 devstack sudo[111198]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569 1G" returned: 0 in 0.718s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:40 devstack sudo[111204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569
Apr 29 10:45:40 devstack sudo[111204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:41 devstack sudo[111204]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569" returned: 0 in 0.662s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:41 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569 is being set with open permissions: ugo+rw
Apr 29 10:45:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:41 devstack sudo[111209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569
Apr 29 10:45:41 devstack sudo[111209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:42 devstack sudo[111209]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569" returned: 0 in 0.609s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:42 devstack sudo[111212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.info
Apr 29 10:45:42 devstack sudo[111212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:42 devstack sudo[111212]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.info" returned: 0 in 0.586s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:42 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.info is being set with open permissions: ugo+rw
Apr 29 10:45:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:42 devstack sudo[111215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.info
Apr 29 10:45:42 devstack sudo[111215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:43 devstack sudo[111215]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.info" returned: 0 in 0.602s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.970s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:45:43 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-88bc908c-bd9c-4404-88bb-68597222552f tempest-SnapshotDependencyTests-936320387 None] Create snapshot completed successfully
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Flow 'volume_create_manager' (60aece07-0aca-4348-8c2b-8bf19da78454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a23f55-04b5-49da-be8c-a02b6a577ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a23f55-04b5-49da-be8c-a02b6a577ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d18c951-c608-4328-893b-770fef57ff48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d243c4123d54bd0acff7d9f0335d972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7478cd51-0dfd-45f4-a71a-b01bcca99569,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:45:44Z,use_quota=True,user_id='16d50f72fd2a4ccead3c48c13f54701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714a4647-a13a-4c01-b908-89859b8488c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714a4647-a13a-4c01-b908-89859b8488c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3ff611-5571-4197-ab57-701a0e2bc93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3ff611-5571-4197-ab57-701a0e2bc93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d18c951-c608-4328-893b-770fef57ff48', 'volume_name': 'volume-8d18c951-c608-4328-893b-770fef57ff48', 'volume_size': 1, 'snapshot_id': '7478cd51-0dfd-45f4-a71a-b01bcca99569'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7698d230-a38e-4569-a8a1-30f7026dbb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7698d230-a38e-4569-a8a1-30f7026dbb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21551f53-1557-47c6-a3ed-aa320722a0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:45:44 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Volume 8d18c951-c608-4328-893b-770fef57ff48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d18c951-c608-4328-893b-770fef57ff48', 'volume_size': 1, 'snapshot_id': '7478cd51-0dfd-45f4-a71a-b01bcca99569'}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "cinder-quobyte-7478cd51-0dfd-45f4-a71a-b01bcca99569-8d18c951-c608-4328-893b-770fef57ff48" by "_create_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-quobyte-7478cd51-0dfd-45f4-a71a-b01bcca99569-8d18c951-c608-4328-893b-770fef57ff48" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Creating volume 8d18c951-c608-4328-893b-770fef57ff48 from snapshot 7478cd51-0dfd-45f4-a71a-b01bcca99569 {{(pid=84165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "cinder-quobyte-8d18c951-c608-4328-893b-770fef57ff48" by "_copy_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-quobyte-8d18c951-c608-4328-893b-770fef57ff48" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] snapshot: 7478cd51-0dfd-45f4-a71a-b01bcca99569, volume: 8d18c951-c608-4328-893b-770fef57ff48,  {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1db211-e7d6-4b74-bcc0-e08f01ffd217]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:44 devstack sudo[111219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569
Apr 29 10:45:44 devstack sudo[111219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:44 devstack sudo[111219]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569" returned: 0 in 0.729s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Creating direct copy from snapshot {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27f63ef-c725-4501-ad88-2b46f29591e8]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:45:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:45 devstack sudo[111224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8
Apr 29 10:45:45 devstack sudo[111224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:45 devstack sudo[111224]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8" returned: 0 in 0.701s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:45 devstack cinder-volume[84165]: DEBUG cinder.utils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Path /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8d18c951-c608-4328-893b-770fef57ff48 not found in is_blk_device check {{(pid=84165) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 10:45:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8d18c951-c608-4328-893b-770fef57ff48 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:45 devstack sudo[111229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8d18c951-c608-4328-893b-770fef57ff48
Apr 29 10:45:45 devstack sudo[111229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:50 devstack sudo[111229]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8d18c951-c608-4328-893b-770fef57ff48" returned: 0 in 4.501s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:50 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1048db29-f798-472e-89c2-0eb6150683a8]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:45:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:50 devstack sudo[111242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8
Apr 29 10:45:50 devstack sudo[111242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:51 devstack sudo[111242]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8" returned: 0 in 0.857s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:51 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8d18c951-c608-4328-893b-770fef57ff48 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:45:51 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Converted 1024.00 MB image at 227.43 MB/s
Apr 29 10:45:51 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8d18c951-c608-4328-893b-770fef57ff48 is being set with open permissions: ugo+rw
Apr 29 10:45:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8d18c951-c608-4328-893b-770fef57ff48 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:51 devstack sudo[111247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8d18c951-c608-4328-893b-770fef57ff48
Apr 29 10:45:51 devstack sudo[111247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:51 devstack sudo[111247]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8d18c951-c608-4328-893b-770fef57ff48" returned: 0 in 0.561s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-quobyte-8d18c951-c608-4328-893b-770fef57ff48" released by "_copy_volume_from_snapshot" :: held 7.437s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:45:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-quobyte-7478cd51-0dfd-45f4-a71a-b01bcca99569-8d18c951-c608-4328-893b-770fef57ff48" released by "_create_volume_from_snapshot" :: held 7.473s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:45:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.488s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:45:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21551f53-1557-47c6-a3ed-aa320722a0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d18c951-c608-4328-893b-770fef57ff48', 'volume_size': 1, 'snapshot_id': '7478cd51-0dfd-45f4-a71a-b01bcca99569'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:45:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6d3610-4bc7-4f4b-a9c4-e1fbcf9a62cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:45:51 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Volume volume-8d18c951-c608-4328-893b-770fef57ff48 (8d18c951-c608-4328-893b-770fef57ff48): created successfully
Apr 29 10:45:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6d3610-4bc7-4f4b-a9c4-e1fbcf9a62cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:45:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Flow 'volume_create_manager' (60aece07-0aca-4348-8c2b-8bf19da78454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:45:51 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-23230cdf-d568-4dea-9648-bf4197f21854 tempest-SnapshotDependencyTests-936320387 None] Created volume successfully.
Apr 29 10:45:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "cinder-7478cd51-0dfd-45f4-a71a-b01bcca99569-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:45:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-7478cd51-0dfd-45f4-a71a-b01bcca99569-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:45:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "cinder-quobyte-5c738e95-93d4-4811-8aa2-bf5e5287cea8" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:45:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-quobyte-5c738e95-93d4-4811-8aa2-bf5e5287cea8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:45:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "cinder-quobyte-7478cd51-0dfd-45f4-a71a-b01bcca99569" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:45:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-quobyte-7478cd51-0dfd-45f4-a71a-b01bcca99569" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:45:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Deleting offline snapshot 7478cd51-0dfd-45f4-a71a-b01bcca99569 of volume 5c738e95-93d4-4811-8aa2-bf5e5287cea8 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:45:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] snapshot_file for this snap is: volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:45:52 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[95402145-af41-483f-886b-ed142ca23bb0]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:45:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:53 devstack sudo[111251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569
Apr 29 10:45:53 devstack sudo[111251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:53 devstack sudo[111251]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569" returned: 0 in 0.712s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:45:53 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[50490677-ee5a-42a4-b4a5-ab949171d15a]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:45:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:53 devstack sudo[111256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8
Apr 29 10:45:53 devstack sudo[111256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:54 devstack sudo[111256]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8" returned: 0 in 0.680s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:54 devstack sudo[111262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569
Apr 29 10:45:54 devstack sudo[111262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:54 devstack sudo[111262]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569" returned: 0 in 0.662s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:54 devstack sudo[111267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569
Apr 29 10:45:54 devstack sudo[111267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:55 devstack sudo[111267]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8.7478cd51-0dfd-45f4-a71a-b01bcca99569" returned: 0 in 0.579s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-quobyte-7478cd51-0dfd-45f4-a71a-b01bcca99569" released by "_delete_snapshot" :: held 2.727s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:45:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-quobyte-5c738e95-93d4-4811-8aa2-bf5e5287cea8" released by "delete_snapshot" :: held 2.751s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:45:55 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Created reservations ['9c8d5444-0db5-44cd-95a7-b35ad610e609', '33ce46d6-aa83-4827-bf04-545149e835c5', 'b7a92aa0-cc32-4a79-9c95-c29751e2d5f0', 'a3f3c52d-cd84-440f-8e64-d50066a62ff1'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:45:55 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Delete snapshot completed successfully.
Apr 29 10:45:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-4ad931f3-f4dd-4efc-bc89-0722dda00777 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-7478cd51-0dfd-45f4-a71a-b01bcca99569-delete_snapshot" released by "delete_snapshot" :: held 2.882s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:45:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "cinder-5c738e95-93d4-4811-8aa2-bf5e5287cea8-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:45:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-5c738e95-93d4-4811-8aa2-bf5e5287cea8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:45:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "cinder-quobyte-5c738e95-93d4-4811-8aa2-bf5e5287cea8" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:45:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-quobyte-5c738e95-93d4-4811-8aa2-bf5e5287cea8" acquired by "delete_volume" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:45:56 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f108a1e-d0a3-4adb-9a5b-0b683d7284a7]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:45:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:56 devstack sudo[111270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8
Apr 29 10:45:56 devstack sudo[111270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:56 devstack sudo[111270]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8" returned: 0 in 0.752s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:56 devstack sudo[111275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8
Apr 29 10:45:56 devstack sudo[111275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:57 devstack sudo[111275]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5c738e95-93d4-4811-8aa2-bf5e5287cea8" returned: 0 in 0.584s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-quobyte-5c738e95-93d4-4811-8aa2-bf5e5287cea8" released by "delete_volume" :: held 1.391s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:45:57 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Created reservations ['c0f08244-a791-4bd1-b674-6d3ded079ee6', '3b089be8-f01e-4455-b615-e9fc4cadf1a3', '5f41c12d-40b4-4a55-97cc-103eb68e57bc', '1172619f-f3a2-480e-8a62-e8207a6d43df'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:45:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:45:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:45:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:45:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:45:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:45:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:57 devstack sudo[111278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:45:57 devstack sudo[111278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:58 devstack sudo[111278]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.567s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:58 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:45:58 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Deleted volume successfully.
Apr 29 10:45:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3764d9ff-7797-42b2-85bd-5bbfdc02eba0 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-5c738e95-93d4-4811-8aa2-bf5e5287cea8-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:45:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "cinder-8d18c951-c608-4328-893b-770fef57ff48-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:45:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-8d18c951-c608-4328-893b-770fef57ff48-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:45:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "cinder-quobyte-8d18c951-c608-4328-893b-770fef57ff48" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:45:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-quobyte-8d18c951-c608-4328-893b-770fef57ff48" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:45:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc88c9a0-8c19-4009-90af-3054f0f86722]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:45:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8d18c951-c608-4328-893b-770fef57ff48 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:58 devstack sudo[111281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8d18c951-c608-4328-893b-770fef57ff48
Apr 29 10:45:58 devstack sudo[111281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:59 devstack sudo[111281]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8d18c951-c608-4328-893b-770fef57ff48" returned: 0 in 0.727s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8d18c951-c608-4328-893b-770fef57ff48 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:59 devstack sudo[111286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8d18c951-c608-4328-893b-770fef57ff48
Apr 29 10:45:59 devstack sudo[111286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:45:59 devstack sudo[111286]: pam_unix(sudo:session): session closed for user root
Apr 29 10:45:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-8d18c951-c608-4328-893b-770fef57ff48" returned: 0 in 0.608s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:45:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-quobyte-8d18c951-c608-4328-893b-770fef57ff48" released by "delete_volume" :: held 1.373s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:45:59 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Created reservations ['f0129598-bda4-43a0-8e7c-cdb676cb6f48', '5b2ff432-c4fe-4ffd-837e-b9c9f96f8168', '513146ac-b8e8-423a-837f-f32ac64ec3c1', '093470dd-16e3-4479-9406-c07f0bb396d1'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:45:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:45:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:45:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:45:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:45:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:45:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:45:59 devstack sudo[111289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:45:59 devstack sudo[111289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:00 devstack sudo[111289]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.583s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:00 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:46:00 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Deleted volume successfully.
Apr 29 10:46:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a594974d-7fb8-4d69-b7b5-34209de5eac5 tempest-SnapshotDependencyTests-936320387 None] Lock "cinder-8d18c951-c608-4328-893b-770fef57ff48-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:46:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:05 devstack sudo[111296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:46:05 devstack sudo[111296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:06 devstack sudo[111296]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.673s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:46:09 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=24,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=9 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:46:10 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:UPDATE=26,cinder:SELECT=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Flow 'volume_create_manager' (0b24f0c9-6d57-4351-b6e2-e583ae11b04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b0ba27-38b1-4ed2-bb93-ff11ce00d71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b0ba27-38b1-4ed2-bb93-ff11ce00d71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1209352171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9770b70-34bd-43fd-a947-dc89c130b169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26ffeb315414928b9e50cab4a5162ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:19Z,use_quota=True,user_id='b85c44d9c17e48fdad5bc4d37f9fa82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b27fd99-f048-4eae-ac18-3179bd317dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b27fd99-f048-4eae-ac18-3179bd317dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ace7a69-78a5-4be5-9f85-1443388104d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ace7a69-78a5-4be5-9f85-1443388104d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9770b70-34bd-43fd-a947-dc89c130b169', 'volume_name': 'volume-d9770b70-34bd-43fd-a947-dc89c130b169', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c897ba-cd33-43b7-a3e1-e88724977287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c897ba-cd33-43b7-a3e1-e88724977287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc9e5b5-ee63-4768-b92b-12ea99dc0d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:19 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Volume d9770b70-34bd-43fd-a947-dc89c130b169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9770b70-34bd-43fd-a947-dc89c130b169', 'volume_size': 1}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1209352171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9770b70-34bd-43fd-a947-dc89c130b169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26ffeb315414928b9e50cab4a5162ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:19Z,use_quota=True,user_id='b85c44d9c17e48fdad5bc4d37f9fa82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Creating volume d9770b70-34bd-43fd-a947-dc89c130b169 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:46:19 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d9770b70-34bd-43fd-a947-dc89c130b169 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:19 devstack sudo[111339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d9770b70-34bd-43fd-a947-dc89c130b169 1073741824
Apr 29 10:46:19 devstack sudo[111339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Flow 'volume_create_manager' (080b1b77-926e-4514-9c94-d0cacfc84a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4441ec1b-45aa-4e51-9aff-0ab3bad803de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4441ec1b-45aa-4e51-9aff-0ab3bad803de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-214445945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9318ab93-ddfa-49b3-a51e-929bb1b7d553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8281a5a8f35a4b93b9332020f7cf31f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:19Z,use_quota=True,user_id='f5d0f6c114354f3e90fe2817f1880cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2cc0a5-4c8b-4276-a6b7-990ea0c59f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2cc0a5-4c8b-4276-a6b7-990ea0c59f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60bd7455-73d6-4bac-8e79-139c9bd94db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60bd7455-73d6-4bac-8e79-139c9bd94db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9318ab93-ddfa-49b3-a51e-929bb1b7d553', 'volume_name': 'volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45ff69b-1113-495b-b215-7daa9c095b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45ff69b-1113-495b-b215-7daa9c095b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c7d88b-6fbf-44b3-863c-81a736c3839a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:19 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume 9318ab93-ddfa-49b3-a51e-929bb1b7d553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553', 'volume_size': 1}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:19 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Flow 'volume_create_manager' (7a90a6d6-18c8-4b1f-a427-188d95ba0e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f804fd6-4684-486b-86ed-66ee3e7da397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f804fd6-4684-486b-86ed-66ee3e7da397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2068495847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f8964e-74ba-44bd-8b67-185c73376059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26ffeb315414928b9e50cab4a5162ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:20Z,use_quota=True,user_id='b85c44d9c17e48fdad5bc4d37f9fa82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ab25a6-0098-42a2-bbf1-ed3ed71c0393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ab25a6-0098-42a2-bbf1-ed3ed71c0393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782acb29-f05d-44b5-a1f1-48cdaa4dc1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782acb29-f05d-44b5-a1f1-48cdaa4dc1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66f8964e-74ba-44bd-8b67-185c73376059', 'volume_name': 'volume-66f8964e-74ba-44bd-8b67-185c73376059', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e711a66-d9a4-4a38-9796-00294bb89214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e711a66-d9a4-4a38-9796-00294bb89214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da98868-d76a-42ab-9bf2-03c726e4c6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Volume 66f8964e-74ba-44bd-8b67-185c73376059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66f8964e-74ba-44bd-8b67-185c73376059', 'volume_size': 1}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Flow 'volume_create_manager' (fda0a0be-c3a0-412c-99ca-a0dd8f476b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f1eb01-0d1f-4e9c-83b4-359df90437f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f1eb01-0d1f-4e9c-83b4-359df90437f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-893098620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d681616-5783-4fba-86a0-02bf5ccdfa4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25600ed3628e4baaa820e52c3aa5b6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:20Z,use_quota=True,user_id='70fbba391b4448ad8ea95918d5379d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13f1f30-0582-4311-affc-7b7449c30e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13f1f30-0582-4311-affc-7b7449c30e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7760947-9f64-4729-8640-11c6300f573f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7760947-9f64-4729-8640-11c6300f573f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d681616-5783-4fba-86a0-02bf5ccdfa4f', 'volume_name': 'volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a4e127-19d4-47ed-8d47-36dd71b81754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a4e127-19d4-47ed-8d47-36dd71b81754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4ee434-2a08-4f2c-b486-bc451788e633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Volume 9d681616-5783-4fba-86a0-02bf5ccdfa4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f', 'volume_size': 1}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Flow 'volume_create_manager' (f7a48964-afd1-413c-9548-415a92a888b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464cc956-2b40-4fc8-9a78-92b9c662e88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464cc956-2b40-4fc8-9a78-92b9c662e88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1686482586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487ee34b-ab47-4652-babe-cb7454c93b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26ffeb315414928b9e50cab4a5162ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:20Z,use_quota=True,user_id='b85c44d9c17e48fdad5bc4d37f9fa82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5e9354-1c7d-458a-be3d-6d39b97e7ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5e9354-1c7d-458a-be3d-6d39b97e7ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb0df98-c27f-4008-a3e0-753495e5ef3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb0df98-c27f-4008-a3e0-753495e5ef3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487ee34b-ab47-4652-babe-cb7454c93b39', 'volume_name': 'volume-487ee34b-ab47-4652-babe-cb7454c93b39', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a583fe2-87f1-4322-983e-fc3cd9946a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a583fe2-87f1-4322-983e-fc3cd9946a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f14f971-b0ea-4fbf-a86c-2ec9cd3f7c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Volume 487ee34b-ab47-4652-babe-cb7454c93b39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487ee34b-ab47-4652-babe-cb7454c93b39', 'volume_size': 1}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:20 devstack sudo[111339]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d9770b70-34bd-43fd-a947-dc89c130b169 1073741824" returned: 0 in 1.222s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d9770b70-34bd-43fd-a947-dc89c130b169 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:20 devstack sudo[111346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d9770b70-34bd-43fd-a947-dc89c130b169
Apr 29 10:46:20 devstack sudo[111346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Flow 'volume_create_manager' (fd239296-e079-42d0-83fc-2728d1265a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f00713-c738-401d-9c5d-f6da2ccdbb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f00713-c738-401d-9c5d-f6da2ccdbb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1236838131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fa340c-8b1a-4310-bcb1-284de550bf40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26ffeb315414928b9e50cab4a5162ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:21Z,use_quota=True,user_id='b85c44d9c17e48fdad5bc4d37f9fa82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50e0b7c-0420-4f26-ab71-959b8b71f622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50e0b7c-0420-4f26-ab71-959b8b71f622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51480d5-c80a-4bbb-8bba-c26f71dd5257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51480d5-c80a-4bbb-8bba-c26f71dd5257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2fa340c-8b1a-4310-bcb1-284de550bf40', 'volume_name': 'volume-f2fa340c-8b1a-4310-bcb1-284de550bf40', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020a890b-809d-42b5-926e-476d5c65e5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020a890b-809d-42b5-926e-476d5c65e5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a449233-d362-4050-b876-0cea46c349e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:20 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Volume f2fa340c-8b1a-4310-bcb1-284de550bf40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2fa340c-8b1a-4310-bcb1-284de550bf40', 'volume_size': 1}
Apr 29 10:46:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Flow 'volume_create_manager' (057ed698-6d59-42fc-9cf5-de012e258a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:21 devstack sudo[111346]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f8ce8d-fb6a-4f83-984f-f256a0dd8628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d9770b70-34bd-43fd-a947-dc89c130b169" returned: 0 in 0.686s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.685s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-214445945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9318ab93-ddfa-49b3-a51e-929bb1b7d553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8281a5a8f35a4b93b9332020f7cf31f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:19Z,use_quota=True,user_id='f5d0f6c114354f3e90fe2817f1880cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Creating volume 9318ab93-ddfa-49b3-a51e-929bb1b7d553 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:46:21 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f8ce8d-fb6a-4f83-984f-f256a0dd8628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-652777889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96eaa543-ee10-42b1-bb2c-7ed4b3ed8389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26ffeb315414928b9e50cab4a5162ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:21Z,use_quota=True,user_id='b85c44d9c17e48fdad5bc4d37f9fa82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:21 devstack sudo[111349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553 1073741824
Apr 29 10:46:21 devstack sudo[111349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66736855-15ed-46cb-8352-d8e05edf2889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66736855-15ed-46cb-8352-d8e05edf2889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9406baf-be5a-4ccf-89a4-4d7c82b89da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9406baf-be5a-4ccf-89a4-4d7c82b89da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96eaa543-ee10-42b1-bb2c-7ed4b3ed8389', 'volume_name': 'volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd6f5f4-46af-420e-8e28-5e62a1540276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd6f5f4-46af-420e-8e28-5e62a1540276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a10edc1-1ddc-46f9-9a52-5a0b07f9c048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:21 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Volume 96eaa543-ee10-42b1-bb2c-7ed4b3ed8389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389', 'volume_size': 1}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc9e5b5-ee63-4768-b92b-12ea99dc0d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9770b70-34bd-43fd-a947-dc89c130b169', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a681cfb-785f-4b98-9f2e-fd1e105ecdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:21 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Volume volume-d9770b70-34bd-43fd-a947-dc89c130b169 (d9770b70-34bd-43fd-a947-dc89c130b169): created successfully
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a681cfb-785f-4b98-9f2e-fd1e105ecdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:21 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Flow 'volume_create_manager' (0b24f0c9-6d57-4351-b6e2-e583ae11b04b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:21 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-279656f6-f800-4458-8b56-7ac62393c5b0 tempest-CreateVolumesFromImageTest-661854353 None] Created volume successfully.
Apr 29 10:46:22 devstack sudo[111349]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553 1073741824" returned: 0 in 0.831s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:22 devstack sudo[111356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553
Apr 29 10:46:22 devstack sudo[111356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:22 devstack sudo[111356]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553" returned: 0 in 0.626s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.630s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2068495847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f8964e-74ba-44bd-8b67-185c73376059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26ffeb315414928b9e50cab4a5162ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:20Z,use_quota=True,user_id='b85c44d9c17e48fdad5bc4d37f9fa82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Creating volume 66f8964e-74ba-44bd-8b67-185c73376059 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:46:22 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-66f8964e-74ba-44bd-8b67-185c73376059 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:22 devstack sudo[111365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-66f8964e-74ba-44bd-8b67-185c73376059 1073741824
Apr 29 10:46:22 devstack sudo[111365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c7d88b-6fbf-44b3-863c-81a736c3839a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc11318-ffe5-4924-b3a5-06cf51e33579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:22 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553 (9318ab93-ddfa-49b3-a51e-929bb1b7d553): created successfully
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc11318-ffe5-4924-b3a5-06cf51e33579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:22 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Flow 'volume_create_manager' (080b1b77-926e-4514-9c94-d0cacfc84a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:22 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1aea5a79-6642-4b13-b0af-0a7fdd6732ba tempest-CreateVolumesFromSnapshotTest-1362458789 None] Created volume successfully.
Apr 29 10:46:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:23 devstack sudo[111365]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-66f8964e-74ba-44bd-8b67-185c73376059 1073741824" returned: 0 in 0.894s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-66f8964e-74ba-44bd-8b67-185c73376059 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:23 devstack sudo[111370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-66f8964e-74ba-44bd-8b67-185c73376059
Apr 29 10:46:23 devstack sudo[111370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:24 devstack sudo[111370]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-66f8964e-74ba-44bd-8b67-185c73376059" returned: 0 in 0.735s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.194s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-893098620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d681616-5783-4fba-86a0-02bf5ccdfa4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25600ed3628e4baaa820e52c3aa5b6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:20Z,use_quota=True,user_id='70fbba391b4448ad8ea95918d5379d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Creating volume 9d681616-5783-4fba-86a0-02bf5ccdfa4f {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:46:24 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da98868-d76a-42ab-9bf2-03c726e4c6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f8964e-74ba-44bd-8b67-185c73376059', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:24 devstack sudo[111375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f 1073741824
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0871d696-2a43-40ab-acc2-d0cacd5daff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:24 devstack sudo[111375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:24 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Volume volume-66f8964e-74ba-44bd-8b67-185c73376059 (66f8964e-74ba-44bd-8b67-185c73376059): created successfully
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0871d696-2a43-40ab-acc2-d0cacd5daff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:24 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Flow 'volume_create_manager' (7a90a6d6-18c8-4b1f-a427-188d95ba0e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:24 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c6f08ebc-c74b-44d6-ab21-f1162deccb9b tempest-CreateVolumesFromImageTest-661854353 None] Created volume successfully.
Apr 29 10:46:25 devstack sudo[111375]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f 1073741824" returned: 0 in 0.793s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:25 devstack sudo[111381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f
Apr 29 10:46:25 devstack sudo[111381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:25 devstack sudo[111381]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f" returned: 0 in 0.618s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.412s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1686482586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487ee34b-ab47-4652-babe-cb7454c93b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26ffeb315414928b9e50cab4a5162ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:20Z,use_quota=True,user_id='b85c44d9c17e48fdad5bc4d37f9fa82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Creating volume 487ee34b-ab47-4652-babe-cb7454c93b39 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:46:25 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-487ee34b-ab47-4652-babe-cb7454c93b39 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:25 devstack sudo[111384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-487ee34b-ab47-4652-babe-cb7454c93b39 1073741824
Apr 29 10:46:25 devstack sudo[111384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4ee434-2a08-4f2c-b486-bc451788e633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98363196-3c97-439c-99a0-a29c6a4f6847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:25 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Volume volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f (9d681616-5783-4fba-86a0-02bf5ccdfa4f): created successfully
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98363196-3c97-439c-99a0-a29c6a4f6847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:25 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Flow 'volume_create_manager' (fda0a0be-c3a0-412c-99ca-a0dd8f476b10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:26 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-105f3de8-d570-43c8-aa59-da1f292168b0 tempest-VolumeDependencyTests-363769395 None] Created volume successfully.
Apr 29 10:46:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:26 devstack sudo[111384]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-487ee34b-ab47-4652-babe-cb7454c93b39 1073741824" returned: 0 in 0.892s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-487ee34b-ab47-4652-babe-cb7454c93b39 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:26 devstack sudo[111390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-487ee34b-ab47-4652-babe-cb7454c93b39
Apr 29 10:46:26 devstack sudo[111390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:27 devstack sudo[111390]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-487ee34b-ab47-4652-babe-cb7454c93b39" returned: 0 in 0.642s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.546s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1236838131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fa340c-8b1a-4310-bcb1-284de550bf40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26ffeb315414928b9e50cab4a5162ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:21Z,use_quota=True,user_id='b85c44d9c17e48fdad5bc4d37f9fa82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Creating volume f2fa340c-8b1a-4310-bcb1-284de550bf40 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:46:27 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f2fa340c-8b1a-4310-bcb1-284de550bf40 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:27 devstack sudo[111395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f2fa340c-8b1a-4310-bcb1-284de550bf40 1073741824
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f14f971-b0ea-4fbf-a86c-2ec9cd3f7c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487ee34b-ab47-4652-babe-cb7454c93b39', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:27 devstack sudo[111395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9450b0-a3f9-4fc2-8c0f-92579f34cd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:27 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Volume volume-487ee34b-ab47-4652-babe-cb7454c93b39 (487ee34b-ab47-4652-babe-cb7454c93b39): created successfully
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9450b0-a3f9-4fc2-8c0f-92579f34cd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:27 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Flow 'volume_create_manager' (f7a48964-afd1-413c-9548-415a92a888b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:27 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-660e28c3-f26a-41b4-9fcc-ddde9d2fb97b tempest-CreateVolumesFromImageTest-661854353 None] Created volume successfully.
Apr 29 10:46:28 devstack sudo[111395]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f2fa340c-8b1a-4310-bcb1-284de550bf40 1073741824" returned: 0 in 0.864s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f2fa340c-8b1a-4310-bcb1-284de550bf40 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:28 devstack sudo[111401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f2fa340c-8b1a-4310-bcb1-284de550bf40
Apr 29 10:46:28 devstack sudo[111401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:29 devstack sudo[111401]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f2fa340c-8b1a-4310-bcb1-284de550bf40" returned: 0 in 0.630s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.730s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-652777889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96eaa543-ee10-42b1-bb2c-7ed4b3ed8389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26ffeb315414928b9e50cab4a5162ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:21Z,use_quota=True,user_id='b85c44d9c17e48fdad5bc4d37f9fa82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Creating volume 96eaa543-ee10-42b1-bb2c-7ed4b3ed8389 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:46:29 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:29 devstack sudo[111404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389 1073741824
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a449233-d362-4050-b876-0cea46c349e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2fa340c-8b1a-4310-bcb1-284de550bf40', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:29 devstack sudo[111404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af7a40c-fa33-4c68-ac56-66dd813daa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:29 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Volume volume-f2fa340c-8b1a-4310-bcb1-284de550bf40 (f2fa340c-8b1a-4310-bcb1-284de550bf40): created successfully
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af7a40c-fa33-4c68-ac56-66dd813daa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:29 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Flow 'volume_create_manager' (fd239296-e079-42d0-83fc-2728d1265a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:29 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-218038b1-38d2-46a8-859e-892d4cbb8a4b tempest-CreateVolumesFromImageTest-661854353 None] Created volume successfully.
Apr 29 10:46:30 devstack sudo[111404]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389 1073741824" returned: 0 in 0.976s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:30 devstack sudo[111444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389
Apr 29 10:46:30 devstack sudo[111444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:30 devstack sudo[111444]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389" returned: 0 in 0.702s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:46:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.473s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:30 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Creating offline snapshot d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4 of volume 9318ab93-ddfa-49b3-a51e-929bb1b7d553 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:46:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a10edc1-1ddc-46f9-9a52-5a0b07f9c048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e2014e-ce6a-42bd-adec-f3879d5b4b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:30 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5258ed4-2e7e-4d46-a853-1a2aeeb541e9]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:46:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:30 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Volume volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389 (96eaa543-ee10-42b1-bb2c-7ed4b3ed8389): created successfully
Apr 29 10:46:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e2014e-ce6a-42bd-adec-f3879d5b4b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:30 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Flow 'volume_create_manager' (057ed698-6d59-42fc-9cf5-de012e258a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:30 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-809eb8ac-c981-4643-9b0b-079ef6c2fc6c tempest-CreateVolumesFromImageTest-661854353 None] Created volume successfully.
Apr 29 10:46:30 devstack sudo[111449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553
Apr 29 10:46:30 devstack sudo[111449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "cinder-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "cinder-quobyte-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-quobyte-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389" acquired by "delete_volume" :: waited 0.034s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:31 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4679fa-ce64-4ed4-b7ea-3f9aaa5500ce]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:46:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:31 devstack sudo[111451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389
Apr 29 10:46:31 devstack sudo[111451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:31 devstack sudo[111449]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553" returned: 0 in 0.922s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:31 devstack sudo[111456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4 1G
Apr 29 10:46:31 devstack sudo[111456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:32 devstack sudo[111451]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389" returned: 0 in 0.761s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:32 devstack sudo[111461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389
Apr 29 10:46:32 devstack sudo[111461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:32 devstack sudo[111456]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4 1G" returned: 0 in 0.895s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:32 devstack sudo[111467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4
Apr 29 10:46:32 devstack sudo[111467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:32 devstack sudo[111461]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389" returned: 0 in 0.709s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:32 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-quobyte-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389" released by "delete_volume" :: held 1.554s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:32 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Created reservations ['406b5fa0-cb5f-4bff-88cc-a0161ffeb69b', '41d2ce73-697f-4f06-a32c-aa199d0c06ef', '1e45890c-f6d8-48aa-9a0e-e3e2d1aeb1ef', '829f04d0-bca5-49e8-a531-3908ee1271ab'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:46:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:32 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:32 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:32 devstack sudo[111469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:46:32 devstack sudo[111469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:33 devstack sudo[111467]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4" returned: 0 in 0.774s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:33 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4 is being set with open permissions: ugo+rw
Apr 29 10:46:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:33 devstack sudo[111474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4
Apr 29 10:46:33 devstack sudo[111474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "cinder-f2fa340c-8b1a-4310-bcb1-284de550bf40-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-f2fa340c-8b1a-4310-bcb1-284de550bf40-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "cinder-quobyte-f2fa340c-8b1a-4310-bcb1-284de550bf40" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-quobyte-f2fa340c-8b1a-4310-bcb1-284de550bf40" acquired by "delete_volume" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:33 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b1a6af-4655-4778-a39d-aa432c0ef99e]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:46:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f2fa340c-8b1a-4310-bcb1-284de550bf40 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:33 devstack sudo[111469]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.736s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:33 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:46:33 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Deleted volume successfully.
Apr 29 10:46:33 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-29e0f918-51ef-4b53-add3-ebb1f9919492 tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-96eaa543-ee10-42b1-bb2c-7ed4b3ed8389-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:33 devstack sudo[111477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f2fa340c-8b1a-4310-bcb1-284de550bf40
Apr 29 10:46:33 devstack sudo[111477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:34 devstack sudo[111474]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4" returned: 0 in 0.752s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:34 devstack sudo[111481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.info
Apr 29 10:46:34 devstack sudo[111481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:34 devstack sudo[111477]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f2fa340c-8b1a-4310-bcb1-284de550bf40" returned: 0 in 0.880s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f2fa340c-8b1a-4310-bcb1-284de550bf40 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:34 devstack sudo[111487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f2fa340c-8b1a-4310-bcb1-284de550bf40
Apr 29 10:46:34 devstack sudo[111487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:34 devstack sudo[111481]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.info" returned: 0 in 0.717s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:34 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.info is being set with open permissions: ugo+rw
Apr 29 10:46:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:34 devstack sudo[111491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.info
Apr 29 10:46:34 devstack sudo[111491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:35 devstack sudo[111487]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f2fa340c-8b1a-4310-bcb1-284de550bf40" returned: 0 in 0.766s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-quobyte-f2fa340c-8b1a-4310-bcb1-284de550bf40" released by "delete_volume" :: held 1.714s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Created reservations ['f3b8403f-e34a-4130-9d81-2c56796f7504', '88cf5a2d-3aa7-4896-9bb1-9371f43dd10d', '35d4bec8-e67b-4e61-9934-159b2cd39202', '96ed66c7-a7fc-4707-86e5-d3207c5a714e'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:35 devstack sudo[111494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:46:35 devstack sudo[111494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:35 devstack sudo[111491]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.info" returned: 0 in 0.604s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.789s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.937s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] Creating offline snapshot 18f8f445-076e-4299-bf0f-c2f1af729b14 of volume 9d681616-5783-4fba-86a0-02bf5ccdfa4f {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:46:35 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-2b83c151-275f-46a5-8475-b83c183a0795 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Create snapshot completed successfully
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca442bf8-47f6-4395-b85a-57496afca693]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:35 devstack sudo[111497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f
Apr 29 10:46:35 devstack sudo[111497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "cinder-487ee34b-ab47-4652-babe-cb7454c93b39-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-487ee34b-ab47-4652-babe-cb7454c93b39-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "cinder-quobyte-487ee34b-ab47-4652-babe-cb7454c93b39" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-quobyte-487ee34b-ab47-4652-babe-cb7454c93b39" acquired by "delete_volume" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[91235227-9ebd-4de1-8792-84547f810552]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:46:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-487ee34b-ab47-4652-babe-cb7454c93b39 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:36 devstack sudo[111499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-487ee34b-ab47-4652-babe-cb7454c93b39
Apr 29 10:46:36 devstack sudo[111499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:36 devstack sudo[111494]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.026s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:36 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:46:36 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Deleted volume successfully.
Apr 29 10:46:36 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-89de533d-7f87-4cb1-94e3-1d40a4926a4b tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-f2fa340c-8b1a-4310-bcb1-284de550bf40-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:36 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:46:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Flow 'volume_create_manager' (abb334f0-a63c-4130-b88d-a15ae28eecaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caefc33a-e72e-4ef3-91f0-e8d402322f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:36 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caefc33a-e72e-4ef3-91f0-e8d402322f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1445042503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f40c57-d051-45b2-b892-281438c118db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8281a5a8f35a4b93b9332020f7cf31f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:37Z,use_quota=True,user_id='f5d0f6c114354f3e90fe2817f1880cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11e5001-724c-4076-8899-ec5706679468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11e5001-724c-4076-8899-ec5706679468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cb8abf-87c4-4ec3-afa4-da83c47b6da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cb8abf-87c4-4ec3-afa4-da83c47b6da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f40c57-d051-45b2-b892-281438c118db', 'volume_name': 'volume-84f40c57-d051-45b2-b892-281438c118db', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed73361-486b-4c80-8523-75b3ec6416f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed73361-486b-4c80-8523-75b3ec6416f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d376ce-fddb-457e-9d2f-17caa5001b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:37 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume 84f40c57-d051-45b2-b892-281438c118db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f40c57-d051-45b2-b892-281438c118db', 'volume_size': 1}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:37 devstack sudo[111499]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-487ee34b-ab47-4652-babe-cb7454c93b39" returned: 0 in 1.249s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-487ee34b-ab47-4652-babe-cb7454c93b39 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:37 devstack sudo[111508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-487ee34b-ab47-4652-babe-cb7454c93b39
Apr 29 10:46:37 devstack sudo[111508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:37 devstack sudo[111497]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f" returned: 0 in 1.696s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:37 devstack sudo[111510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14 1G
Apr 29 10:46:37 devstack sudo[111510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Flow 'volume_create_manager' (7ca893dc-90f2-47fb-bca4-bfb03d3fcca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866804c7-bc02-4567-bbf9-c320a15fd44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866804c7-bc02-4567-bbf9-c320a15fd44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-855798426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bc8ecf-dd54-4f4e-aeec-254d80ba5896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8281a5a8f35a4b93b9332020f7cf31f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:37Z,use_quota=True,user_id='f5d0f6c114354f3e90fe2817f1880cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ce9d0b-d996-45ec-b1d8-c868fcc186c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ce9d0b-d996-45ec-b1d8-c868fcc186c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b438c66d-2d82-47f6-8e13-51a63b1e8d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b438c66d-2d82-47f6-8e13-51a63b1e8d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45bc8ecf-dd54-4f4e-aeec-254d80ba5896', 'volume_name': 'volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39abc5ed-a8f0-44ba-897e-fe12e55ea414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39abc5ed-a8f0-44ba-897e-fe12e55ea414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6ef14d-3425-4f04-a8f1-4f982f937a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:37 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume 45bc8ecf-dd54-4f4e-aeec-254d80ba5896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896', 'volume_size': 1}
Apr 29 10:46:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Flow 'volume_create_manager' (216d6813-47a3-4850-94b0-9d32ccb8fb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce00e0e-cd71-4e5c-8eb3-994eb2b5f153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:38 devstack sudo[111508]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce00e0e-cd71-4e5c-8eb3-994eb2b5f153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1777290208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3459d0a7-6238-44ad-a42f-9470ddc3e67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8281a5a8f35a4b93b9332020f7cf31f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:38Z,use_quota=True,user_id='f5d0f6c114354f3e90fe2817f1880cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207b4712-243e-4358-b2a1-4a3f26a18e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207b4712-243e-4358-b2a1-4a3f26a18e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f06268e-ddb5-43c9-924a-124dd729245d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f06268e-ddb5-43c9-924a-124dd729245d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3459d0a7-6238-44ad-a42f-9470ddc3e67c', 'volume_name': 'volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c586b6ba-9cd4-4cf0-87ba-7e2fced2358f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c586b6ba-9cd4-4cf0-87ba-7e2fced2358f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc7d0f4-a738-48bf-9bd4-408bee1e1e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:38 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume 3459d0a7-6238-44ad-a42f-9470ddc3e67c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c', 'volume_size': 1}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-487ee34b-ab47-4652-babe-cb7454c93b39" returned: 0 in 1.060s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-quobyte-487ee34b-ab47-4652-babe-cb7454c93b39" released by "delete_volume" :: held 2.400s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Created reservations ['74dfded7-ad57-43c3-a213-56f7fd6f67f8', 'c0a3c3a3-5f97-4637-89af-fdde5fba2da5', '2f2e19e0-1bfb-4664-9930-3402c2c5a137', 'bc1cd5fa-432a-44e4-84c4-2186b2580001'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:38 devstack sudo[111516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:46:38 devstack sudo[111516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Flow 'volume_create_manager' (838faac7-af84-468f-b8c4-369596fe3307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f3892a8-3504-47f9-b3a7-ce8ce014b92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f3892a8-3504-47f9-b3a7-ce8ce014b92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-993084767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4aa18c-f0d4-44cc-89b1-0447e262b403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8281a5a8f35a4b93b9332020f7cf31f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:39Z,use_quota=True,user_id='f5d0f6c114354f3e90fe2817f1880cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a98c3ed-45f4-4597-8b53-0afbc998fa35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a98c3ed-45f4-4597-8b53-0afbc998fa35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388d366b-2995-46ad-9d1f-06bd55061a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388d366b-2995-46ad-9d1f-06bd55061a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4aa18c-f0d4-44cc-89b1-0447e262b403', 'volume_name': 'volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1ff331-fb59-4383-bf60-1790dbfc0846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1ff331-fb59-4383-bf60-1790dbfc0846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0443f85-4070-476b-944a-fa1e9baaa072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:38 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume 4d4aa18c-f0d4-44cc-89b1-0447e262b403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403', 'volume_size': 1}
Apr 29 10:46:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:39 devstack sudo[111510]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14 1G" returned: 0 in 1.689s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:39 devstack sudo[111518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14
Apr 29 10:46:39 devstack sudo[111518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Flow 'volume_create_manager' (1e583587-79da-4605-b465-3c71a1266f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602eac3c-5550-45a9-b92a-c4094dc88288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602eac3c-5550-45a9-b92a-c4094dc88288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1067347424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e28780-d032-42a3-821b-d52f47ebf652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8281a5a8f35a4b93b9332020f7cf31f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:39Z,use_quota=True,user_id='f5d0f6c114354f3e90fe2817f1880cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc2ddb9-4780-4dd5-a89a-c7caa26baf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc2ddb9-4780-4dd5-a89a-c7caa26baf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4911f0-2929-4ddf-9eba-8aba4fa602f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4911f0-2929-4ddf-9eba-8aba4fa602f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1e28780-d032-42a3-821b-d52f47ebf652', 'volume_name': 'volume-f1e28780-d032-42a3-821b-d52f47ebf652', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b29ec35-7602-4cf5-9083-f8783e4bf845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b29ec35-7602-4cf5-9083-f8783e4bf845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f7d7f6-23c2-4431-b60c-737d4ebe3111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:39 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume f1e28780-d032-42a3-821b-d52f47ebf652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1e28780-d032-42a3-821b-d52f47ebf652', 'volume_size': 1}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "cinder-66f8964e-74ba-44bd-8b67-185c73376059-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:39 devstack sudo[111516]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.900s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:46:39 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Deleted volume successfully.
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-66f8964e-74ba-44bd-8b67-185c73376059-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a7a47a9-951b-4d12-a979-51c0fef5615a tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-487ee34b-ab47-4652-babe-cb7454c93b39-delete_volume" released by "delete_volume" :: held 3.624s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "cinder-quobyte-66f8964e-74ba-44bd-8b67-185c73376059" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-quobyte-66f8964e-74ba-44bd-8b67-185c73376059" acquired by "delete_volume" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7acab37-a8fb-4a6e-a458-a4c62e0463b2]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-66f8964e-74ba-44bd-8b67-185c73376059 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:39 devstack sudo[111521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-66f8964e-74ba-44bd-8b67-185c73376059
Apr 29 10:46:39 devstack sudo[111521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:39 devstack sudo[111518]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14" returned: 0 in 0.867s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:39 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14 is being set with open permissions: ugo+rw
Apr 29 10:46:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:39 devstack sudo[111526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14
Apr 29 10:46:39 devstack sudo[111526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:40 devstack sudo[111521]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-66f8964e-74ba-44bd-8b67-185c73376059" returned: 0 in 0.792s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-66f8964e-74ba-44bd-8b67-185c73376059 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:40 devstack sudo[111531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-66f8964e-74ba-44bd-8b67-185c73376059
Apr 29 10:46:40 devstack sudo[111531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:40 devstack sudo[111526]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14" returned: 0 in 0.712s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:40 devstack sudo[111534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.info
Apr 29 10:46:40 devstack sudo[111534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:40 devstack sudo[111531]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-66f8964e-74ba-44bd-8b67-185c73376059" returned: 0 in 0.599s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:40 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-quobyte-66f8964e-74ba-44bd-8b67-185c73376059" released by "delete_volume" :: held 1.451s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Created reservations ['4e2e6f59-0e5f-4315-9e32-198bcd2a8fab', 'b3ba8bb5-b2dc-461f-95da-53103902770d', '972dd838-52d7-4d04-8e75-5be1ab28d7a2', '511178f9-3abd-453e-87d2-8be17aaff3af'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:41 devstack sudo[111537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:46:41 devstack sudo[111537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:41 devstack sudo[111534]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.info" returned: 0 in 0.670s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:41 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.info is being set with open permissions: ugo+rw
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:41 devstack sudo[111540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.info
Apr 29 10:46:41 devstack sudo[111540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "cinder-d9770b70-34bd-43fd-a947-dc89c130b169-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-d9770b70-34bd-43fd-a947-dc89c130b169-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:41 devstack sudo[111537]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.637s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:46:41 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Deleted volume successfully.
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-f31a94ba-6755-4f85-a21b-d5a18b89285f tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-66f8964e-74ba-44bd-8b67-185c73376059-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "cinder-quobyte-d9770b70-34bd-43fd-a947-dc89c130b169" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-quobyte-d9770b70-34bd-43fd-a947-dc89c130b169" acquired by "delete_volume" :: waited 0.038s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b18814-7df7-4a54-887a-d29ed58cb920]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:46:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d9770b70-34bd-43fd-a947-dc89c130b169 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:42 devstack sudo[111543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d9770b70-34bd-43fd-a947-dc89c130b169
Apr 29 10:46:42 devstack sudo[111543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:42 devstack sudo[111540]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.info" returned: 0 in 0.819s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.588s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.092s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1445042503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f40c57-d051-45b2-b892-281438c118db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8281a5a8f35a4b93b9332020f7cf31f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:37Z,use_quota=True,user_id='f5d0f6c114354f3e90fe2817f1880cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:46:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Creating volume 84f40c57-d051-45b2-b892-281438c118db {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:46:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:42 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:46:42 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:46:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84f40c57-d051-45b2-b892-281438c118db 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:42 devstack sudo[111546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84f40c57-d051-45b2-b892-281438c118db 1073741824
Apr 29 10:46:42 devstack sudo[111546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:42 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e958f880-e972-44fc-a1be-9d64191e5e20 tempest-VolumeDependencyTests-363769395 None] Create snapshot completed successfully
Apr 29 10:46:42 devstack sudo[111543]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d9770b70-34bd-43fd-a947-dc89c130b169" returned: 0 in 0.817s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d9770b70-34bd-43fd-a947-dc89c130b169 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:42 devstack sudo[111555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d9770b70-34bd-43fd-a947-dc89c130b169
Apr 29 10:46:42 devstack sudo[111555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Flow 'volume_create_manager' (0fe89cfd-12bd-402a-a1e9-56a1d121b251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737f9dab-2f12-4175-9c71-a418e336e788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737f9dab-2f12-4175-9c71-a418e336e788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1953981695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f9026af-ee71-4783-a20b-7711d39c3b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25600ed3628e4baaa820e52c3aa5b6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=18f8f445-076e-4299-bf0f-c2f1af729b14,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:43Z,use_quota=True,user_id='70fbba391b4448ad8ea95918d5379d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3af14af-25ac-4dda-bba8-aedf5d700d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3af14af-25ac-4dda-bba8-aedf5d700d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d1c4ad-a28f-4052-a6b3-267e7d2c8994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d1c4ad-a28f-4052-a6b3-267e7d2c8994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f9026af-ee71-4783-a20b-7711d39c3b05', 'volume_name': 'volume-4f9026af-ee71-4783-a20b-7711d39c3b05', 'volume_size': 1, 'snapshot_id': '18f8f445-076e-4299-bf0f-c2f1af729b14'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c754d01c-e278-4e74-bbf9-b94eb9295dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c754d01c-e278-4e74-bbf9-b94eb9295dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a37f31-512a-4546-ad26-332a571c31f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:43 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Volume 4f9026af-ee71-4783-a20b-7711d39c3b05: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f9026af-ee71-4783-a20b-7711d39c3b05', 'volume_size': 1, 'snapshot_id': '18f8f445-076e-4299-bf0f-c2f1af729b14'}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:43 devstack sudo[111546]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84f40c57-d051-45b2-b892-281438c118db 1073741824" returned: 0 in 1.030s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84f40c57-d051-45b2-b892-281438c118db {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:43 devstack sudo[111557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84f40c57-d051-45b2-b892-281438c118db
Apr 29 10:46:43 devstack sudo[111557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Flow 'volume_create_manager' (5f4ec804-927f-41a9-885e-d62ada2ae2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe316b60-bd5a-4590-9811-2c5cd1807e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe316b60-bd5a-4590-9811-2c5cd1807e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2086049068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2025592a-d025-4e4e-bd21-22ff5deb2099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e777a23d733e488d9a3f16605b7ac297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:43Z,use_quota=True,user_id='ff39c0860d9c47aa8550c18786b560fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9653f440-cf61-497d-a967-89aeafab7b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9653f440-cf61-497d-a967-89aeafab7b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2a4c9f-d8c7-44b3-bf72-dd556dcab18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2a4c9f-d8c7-44b3-bf72-dd556dcab18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2025592a-d025-4e4e-bd21-22ff5deb2099', 'volume_name': 'volume-2025592a-d025-4e4e-bd21-22ff5deb2099', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fec9dd1-1c07-436e-b583-8492e606314a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fec9dd1-1c07-436e-b583-8492e606314a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371c442d-c9d9-4c38-9a5e-2e09729440fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:43 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Volume 2025592a-d025-4e4e-bd21-22ff5deb2099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2025592a-d025-4e4e-bd21-22ff5deb2099', 'volume_size': 1}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:43 devstack sudo[111555]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-d9770b70-34bd-43fd-a947-dc89c130b169" returned: 0 in 0.750s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-quobyte-d9770b70-34bd-43fd-a947-dc89c130b169" released by "delete_volume" :: held 1.631s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Created reservations ['6c6ed91e-81b4-46bb-8f60-1c1daa3124f0', '3337362c-e2bc-4b46-84d7-976ee6a2bd99', '1bb51447-e5d4-4232-969d-bc4987a4070b', 'b6d3d1e6-76b6-4706-ac63-dcdad5444672'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:43 devstack sudo[111560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:46:43 devstack sudo[111560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:43 devstack sudo[111557]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84f40c57-d051-45b2-b892-281438c118db" returned: 0 in 0.653s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.369s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-855798426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bc8ecf-dd54-4f4e-aeec-254d80ba5896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8281a5a8f35a4b93b9332020f7cf31f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:37Z,use_quota=True,user_id='f5d0f6c114354f3e90fe2817f1880cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Creating volume 45bc8ecf-dd54-4f4e-aeec-254d80ba5896 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:46:43 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:46:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:43 devstack sudo[111563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896 1073741824
Apr 29 10:46:43 devstack sudo[111563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d376ce-fddb-457e-9d2f-17caa5001b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f40c57-d051-45b2-b892-281438c118db', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca69837-02a9-4ae4-a72a-7bec97603d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:44 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume volume-84f40c57-d051-45b2-b892-281438c118db (84f40c57-d051-45b2-b892-281438c118db): created successfully
Apr 29 10:46:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca69837-02a9-4ae4-a72a-7bec97603d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Flow 'volume_create_manager' (abb334f0-a63c-4130-b88d-a15ae28eecaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:44 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-7f45b57a-17f0-4caf-ad6f-9a5987e114dd tempest-CreateVolumesFromSnapshotTest-1362458789 None] Created volume successfully.
Apr 29 10:46:44 devstack sudo[111560]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.630s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:44 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:46:44 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Deleted volume successfully.
Apr 29 10:46:44 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c68b1369-997e-49c6-b10e-c2b68fdebcaa tempest-CreateVolumesFromImageTest-661854353 None] Lock "cinder-d9770b70-34bd-43fd-a947-dc89c130b169-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:44 devstack sudo[111563]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896 1073741824" returned: 0 in 0.887s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:44 devstack sudo[111571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896
Apr 29 10:46:44 devstack sudo[111571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:45 devstack sudo[111571]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896" returned: 0 in 0.655s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.265s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1777290208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3459d0a7-6238-44ad-a42f-9470ddc3e67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8281a5a8f35a4b93b9332020f7cf31f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:38Z,use_quota=True,user_id='f5d0f6c114354f3e90fe2817f1880cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Creating volume 3459d0a7-6238-44ad-a42f-9470ddc3e67c {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:46:45 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:45 devstack sudo[111574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c 1073741824
Apr 29 10:46:45 devstack sudo[111574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6ef14d-3425-4f04-a8f1-4f982f937a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34dbb6a5-8fb4-4215-b454-f326515936f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:45 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896 (45bc8ecf-dd54-4f4e-aeec-254d80ba5896): created successfully
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34dbb6a5-8fb4-4215-b454-f326515936f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Flow 'volume_create_manager' (7ca893dc-90f2-47fb-bca4-bfb03d3fcca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:45 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-43af2830-dfdd-49e2-a00d-6d47ae547a7b tempest-CreateVolumesFromSnapshotTest-1362458789 None] Created volume successfully.
Apr 29 10:46:46 devstack sudo[111574]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c 1073741824" returned: 0 in 0.830s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:46 devstack sudo[111579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c
Apr 29 10:46:46 devstack sudo[111579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:46 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:46:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Flow 'volume_create_manager' (c9206da1-1741-40c2-b3f9-fa07b48d2fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5f71c7-4a4e-4b81-bcb1-732f82e1887d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5f71c7-4a4e-4b81-bcb1-732f82e1887d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87994e7f-83a4-49e9-8778-93cad013fbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d62fe4b3f6149a7bccffe02aefb2f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:47Z,use_quota=True,user_id='cfeed916e9d14faea2e058766a4827da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0acd1b4-5e48-45e1-a39a-b600589d9476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:47 devstack sudo[111579]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0acd1b4-5e48-45e1-a39a-b600589d9476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3889d892-8045-49e5-8452-0c2be93e52cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3889d892-8045-49e5-8452-0c2be93e52cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87994e7f-83a4-49e9-8778-93cad013fbf4', 'volume_name': 'volume-87994e7f-83a4-49e9-8778-93cad013fbf4', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f761b4-1063-4f56-933a-83c086e831d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f761b4-1063-4f56-933a-83c086e831d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb4da50-6d59-42c2-b17b-639f7c04be09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:47 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Volume 87994e7f-83a4-49e9-8778-93cad013fbf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87994e7f-83a4-49e9-8778-93cad013fbf4', 'volume_size': 1}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c" returned: 0 in 0.648s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.136s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-993084767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4aa18c-f0d4-44cc-89b1-0447e262b403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8281a5a8f35a4b93b9332020f7cf31f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:39Z,use_quota=True,user_id='f5d0f6c114354f3e90fe2817f1880cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Creating volume 4d4aa18c-f0d4-44cc-89b1-0447e262b403 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:46:47 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc7d0f4-a738-48bf-9bd4-408bee1e1e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:47 devstack sudo[111582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403 1073741824
Apr 29 10:46:47 devstack sudo[111582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71fddc2-2474-40f0-8798-0a7de182c589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:47 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c (3459d0a7-6238-44ad-a42f-9470ddc3e67c): created successfully
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71fddc2-2474-40f0-8798-0a7de182c589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Flow 'volume_create_manager' (216d6813-47a3-4850-94b0-9d32ccb8fb01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:47 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-72a987b2-d584-4e16-8296-a8e35d8d618e tempest-CreateVolumesFromSnapshotTest-1362458789 None] Created volume successfully.
Apr 29 10:46:47 devstack sudo[111582]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403 1073741824" returned: 0 in 0.789s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:47 devstack sudo[111588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403
Apr 29 10:46:47 devstack sudo[111588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:48 devstack sudo[111588]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403" returned: 0 in 0.597s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.142s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1067347424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e28780-d032-42a3-821b-d52f47ebf652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8281a5a8f35a4b93b9332020f7cf31f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:39Z,use_quota=True,user_id='f5d0f6c114354f3e90fe2817f1880cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Creating volume f1e28780-d032-42a3-821b-d52f47ebf652 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:46:48 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1e28780-d032-42a3-821b-d52f47ebf652 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0443f85-4070-476b-944a-fa1e9baaa072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7750ad-a534-4d29-ac46-a3085b3a1a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:48 devstack sudo[111591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1e28780-d032-42a3-821b-d52f47ebf652 1073741824
Apr 29 10:46:48 devstack sudo[111591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:48 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403 (4d4aa18c-f0d4-44cc-89b1-0447e262b403): created successfully
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7750ad-a534-4d29-ac46-a3085b3a1a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Flow 'volume_create_manager' (838faac7-af84-468f-b8c4-369596fe3307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:48 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-4640ca4d-9cd1-4f48-94b2-139e37cd7712 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Created volume successfully.
Apr 29 10:46:49 devstack sudo[111591]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1e28780-d032-42a3-821b-d52f47ebf652 1073741824" returned: 0 in 0.773s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1e28780-d032-42a3-821b-d52f47ebf652 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:49 devstack sudo[111596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1e28780-d032-42a3-821b-d52f47ebf652
Apr 29 10:46:49 devstack sudo[111596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:49 devstack sudo[111596]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1e28780-d032-42a3-821b-d52f47ebf652" returned: 0 in 0.602s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.770s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Acquiring lock "cinder-quobyte-18f8f445-076e-4299-bf0f-c2f1af729b14-4f9026af-ee71-4783-a20b-7711d39c3b05" by "_create_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-18f8f445-076e-4299-bf0f-c2f1af729b14-4f9026af-ee71-4783-a20b-7711d39c3b05" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Creating volume 4f9026af-ee71-4783-a20b-7711d39c3b05 from snapshot 18f8f445-076e-4299-bf0f-c2f1af729b14 {{(pid=84165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Acquiring lock "cinder-quobyte-4f9026af-ee71-4783-a20b-7711d39c3b05" by "_copy_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f7d7f6-23c2-4431-b60c-737d4ebe3111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e28780-d032-42a3-821b-d52f47ebf652', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff67a8c2-9dba-4619-8d0f-6a280c9ba4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-4f9026af-ee71-4783-a20b-7711d39c3b05" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] snapshot: 18f8f445-076e-4299-bf0f-c2f1af729b14, volume: 4f9026af-ee71-4783-a20b-7711d39c3b05,  {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 10:46:49 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Volume volume-f1e28780-d032-42a3-821b-d52f47ebf652 (f1e28780-d032-42a3-821b-d52f47ebf652): created successfully
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff67a8c2-9dba-4619-8d0f-6a280c9ba4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Flow 'volume_create_manager' (1e583587-79da-4605-b465-3c71a1266f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:50 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:50 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:50 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-14fecfcf-95d4-4268-ae63-3d774abab972 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Created volume successfully.
Apr 29 10:46:50 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[818674f3-e369-41fa-9eac-7727498bdabd]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:46:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:50 devstack sudo[111599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14
Apr 29 10:46:50 devstack sudo[111599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:50 devstack sudo[111599]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14" returned: 0 in 0.712s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:50 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:46:50 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 10:46:50 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Creating direct copy from snapshot {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 10:46:50 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcdd028-969f-4213-854b-3f42a34c45ca]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:46:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:50 devstack sudo[111604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f
Apr 29 10:46:50 devstack sudo[111604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "cinder-f1e28780-d032-42a3-821b-d52f47ebf652-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-f1e28780-d032-42a3-821b-d52f47ebf652-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "cinder-quobyte-f1e28780-d032-42a3-821b-d52f47ebf652" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-f1e28780-d032-42a3-821b-d52f47ebf652" acquired by "delete_volume" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:51 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e5a3a4-538c-419e-909a-6614f7771dad]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:46:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1e28780-d032-42a3-821b-d52f47ebf652 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:51 devstack sudo[111606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1e28780-d032-42a3-821b-d52f47ebf652
Apr 29 10:46:51 devstack sudo[111606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:51 devstack sudo[111604]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f" returned: 0 in 0.761s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:51 devstack cinder-volume[84165]: DEBUG cinder.utils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Path /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4f9026af-ee71-4783-a20b-7711d39c3b05 not found in is_blk_device check {{(pid=84165) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 10:46:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4f9026af-ee71-4783-a20b-7711d39c3b05 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:51 devstack sudo[111611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4f9026af-ee71-4783-a20b-7711d39c3b05
Apr 29 10:46:51 devstack sudo[111611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:51 devstack sudo[111606]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1e28780-d032-42a3-821b-d52f47ebf652" returned: 0 in 0.723s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1e28780-d032-42a3-821b-d52f47ebf652 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:51 devstack sudo[111616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1e28780-d032-42a3-821b-d52f47ebf652
Apr 29 10:46:52 devstack sudo[111616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:52 devstack sudo[111616]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-f1e28780-d032-42a3-821b-d52f47ebf652" returned: 0 in 1.013s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-f1e28780-d032-42a3-821b-d52f47ebf652" released by "delete_volume" :: held 1.800s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:53 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Created reservations ['e1928aa5-5728-4d28-b279-5bf84cbf9934', 'f7551389-a30f-4106-be5e-9398356a909a', '57105433-592d-43be-9a5b-d1c357bd009c', '21b2120b-685d-4b89-9b09-c255d4a6347a'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:46:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:53 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:53 devstack sudo[111630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:46:53 devstack sudo[111630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "cinder-4d4aa18c-f0d4-44cc-89b1-0447e262b403-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-4d4aa18c-f0d4-44cc-89b1-0447e262b403-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "cinder-quobyte-4d4aa18c-f0d4-44cc-89b1-0447e262b403" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-4d4aa18c-f0d4-44cc-89b1-0447e262b403" acquired by "delete_volume" :: waited 0.042s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:53 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6d6c5a-cd24-46f3-b4a7-3a5577cab313]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:46:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:54 devstack sudo[111632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403
Apr 29 10:46:54 devstack sudo[111632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:54 devstack sudo[111630]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.483s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:54 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:46:54 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Deleted volume successfully.
Apr 29 10:46:54 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-74012ee8-43cd-4be4-a3a7-0b1c63ca5b31 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-f1e28780-d032-42a3-821b-d52f47ebf652-delete_volume" released by "delete_volume" :: held 3.827s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:55 devstack sudo[111632]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403" returned: 0 in 1.763s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:55 devstack sudo[111639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403
Apr 29 10:46:55 devstack sudo[111639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:56 devstack sudo[111639]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4d4aa18c-f0d4-44cc-89b1-0447e262b403" returned: 0 in 1.286s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:56 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-4d4aa18c-f0d4-44cc-89b1-0447e262b403" released by "delete_volume" :: held 3.159s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:56 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Created reservations ['cecbbb03-0fa9-4c19-a841-abfbf0965265', '475183d9-36ce-4b16-82db-37015046fcd4', '0033fcdf-b529-4e3b-8795-cdef388ef0b4', '99e9795b-f7bc-4161-bcfe-73704f030cef'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:57 devstack sudo[111611]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4f9026af-ee71-4783-a20b-7711d39c3b05" returned: 0 in 5.539s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6dca3c-d2c7-4d3c-aeab-af93285f6289]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:57 devstack sudo[111642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:46:57 devstack sudo[111642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:57 devstack sudo[111644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f
Apr 29 10:46:57 devstack sudo[111644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "cinder-3459d0a7-6238-44ad-a42f-9470ddc3e67c-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-3459d0a7-6238-44ad-a42f-9470ddc3e67c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "cinder-quobyte-3459d0a7-6238-44ad-a42f-9470ddc3e67c" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-3459d0a7-6238-44ad-a42f-9470ddc3e67c" acquired by "delete_volume" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[39491494-73a1-4449-9042-d56829724b0a]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:57 devstack sudo[111646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c
Apr 29 10:46:57 devstack sudo[111646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:57 devstack sudo[111642]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.660s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:46:57 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Deleted volume successfully.
Apr 29 10:46:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0a534762-eeab-4dc4-8725-d3c8a1331223 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-4d4aa18c-f0d4-44cc-89b1-0447e262b403-delete_volume" released by "delete_volume" :: held 4.170s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:58 devstack sudo[111644]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f" returned: 0 in 0.943s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4f9026af-ee71-4783-a20b-7711d39c3b05 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:46:58 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Converted 1024.00 MB image at 184.81 MB/s
Apr 29 10:46:58 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4f9026af-ee71-4783-a20b-7711d39c3b05 is being set with open permissions: ugo+rw
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4f9026af-ee71-4783-a20b-7711d39c3b05 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:58 devstack sudo[111655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4f9026af-ee71-4783-a20b-7711d39c3b05
Apr 29 10:46:58 devstack sudo[111655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:58 devstack sudo[111646]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c" returned: 0 in 0.732s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:58 devstack sudo[111657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c
Apr 29 10:46:58 devstack sudo[111657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:58 devstack sudo[111655]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4f9026af-ee71-4783-a20b-7711d39c3b05" returned: 0 in 0.608s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-4f9026af-ee71-4783-a20b-7711d39c3b05" released by "_copy_volume_from_snapshot" :: held 8.691s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-18f8f445-076e-4299-bf0f-c2f1af729b14-4f9026af-ee71-4783-a20b-7711d39c3b05" released by "_create_volume_from_snapshot" :: held 8.739s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.760s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.165s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2086049068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2025592a-d025-4e4e-bd21-22ff5deb2099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e777a23d733e488d9a3f16605b7ac297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:43Z,use_quota=True,user_id='ff39c0860d9c47aa8550c18786b560fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Creating volume 2025592a-d025-4e4e-bd21-22ff5deb2099 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:46:58 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:58 devstack sudo[111661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099 1073741824
Apr 29 10:46:58 devstack sudo[111657]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:58 devstack sudo[111661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3459d0a7-6238-44ad-a42f-9470ddc3e67c" returned: 0 in 0.611s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-3459d0a7-6238-44ad-a42f-9470ddc3e67c" released by "delete_volume" :: held 1.391s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a37f31-512a-4546-ad26-332a571c31f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f9026af-ee71-4783-a20b-7711d39c3b05', 'volume_size': 1, 'snapshot_id': '18f8f445-076e-4299-bf0f-c2f1af729b14'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b6fd7b-ab30-43c6-bc75-a7fdf6fa2c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:46:58 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Volume volume-4f9026af-ee71-4783-a20b-7711d39c3b05 (4f9026af-ee71-4783-a20b-7711d39c3b05): created successfully
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b6fd7b-ab30-43c6-bc75-a7fdf6fa2c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Flow 'volume_create_manager' (0fe89cfd-12bd-402a-a1e9-56a1d121b251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:46:58 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-df3c92a4-f534-46f3-a75e-d1724cb2b250 tempest-VolumeDependencyTests-363769395 None] Created volume successfully.
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Created reservations ['4da47b34-f6f7-4f47-a5da-0a82109e55b6', 'db3ccf10-343f-4bee-90ab-23a8154a8cc7', '0489ef6b-15fb-47a2-aa88-e29415dd43d1', '3cbca37d-1810-4c99-8d86-625cd4cd2c3f'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:46:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:58 devstack sudo[111663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:46:58 devstack sudo[111663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Acquiring lock "cinder-18f8f445-076e-4299-bf0f-c2f1af729b14-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:59 devstack sudo[111661]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099 1073741824" returned: 0 in 0.787s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Lock "cinder-18f8f445-076e-4299-bf0f-c2f1af729b14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Acquiring lock "cinder-quobyte-9d681616-5783-4fba-86a0-02bf5ccdfa4f" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:59 devstack sudo[111663]: pam_unix(sudo:session): session closed for user root
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.613s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:46:59 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Deleted volume successfully.
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-9d681616-5783-4fba-86a0-02bf5ccdfa4f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Acquiring lock "cinder-quobyte-18f8f445-076e-4299-bf0f-c2f1af729b14" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-18f8f445-076e-4299-bf0f-c2f1af729b14" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Deleting offline snapshot 18f8f445-076e-4299-bf0f-c2f1af729b14 of volume 9d681616-5783-4fba-86a0-02bf5ccdfa4f {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] snapshot_file for this snap is: volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-8bc9a2b8-28d2-47d2-b85c-d199e20b42b1 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-3459d0a7-6238-44ad-a42f-9470ddc3e67c-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "cinder-45bc8ecf-dd54-4f4e-aeec-254d80ba5896-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75fc17a-cb9e-46db-affb-aea7ad2ed282]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-45bc8ecf-dd54-4f4e-aeec-254d80ba5896-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:59 devstack sudo[111670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099
Apr 29 10:46:59 devstack sudo[111670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "cinder-quobyte-45bc8ecf-dd54-4f4e-aeec-254d80ba5896" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-45bc8ecf-dd54-4f4e-aeec-254d80ba5896" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c64953a-404d-4038-9264-5585ae976f31]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:46:59 devstack sudo[111669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14
Apr 29 10:46:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:46:59 devstack sudo[111669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:46:59 devstack sudo[111673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896
Apr 29 10:46:59 devstack sudo[111673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:00 devstack sudo[111670]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099" returned: 0 in 0.600s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.156s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87994e7f-83a4-49e9-8778-93cad013fbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d62fe4b3f6149a7bccffe02aefb2f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:46:47Z,use_quota=True,user_id='cfeed916e9d14faea2e058766a4827da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Creating volume 87994e7f-83a4-49e9-8778-93cad013fbf4 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:47:00 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-87994e7f-83a4-49e9-8778-93cad013fbf4 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371c442d-c9d9-4c38-9a5e-2e09729440fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2025592a-d025-4e4e-bd21-22ff5deb2099', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:00 devstack sudo[111678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-87994e7f-83a4-49e9-8778-93cad013fbf4 1073741824
Apr 29 10:47:00 devstack sudo[111678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ce4a10-166a-4b45-8282-a211f07a2fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:00 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Volume volume-2025592a-d025-4e4e-bd21-22ff5deb2099 (2025592a-d025-4e4e-bd21-22ff5deb2099): created successfully
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ce4a10-166a-4b45-8282-a211f07a2fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Flow 'volume_create_manager' (5f4ec804-927f-41a9-885e-d62ada2ae2fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:00 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-89bcff2b-e4ae-4859-9ef7-44036d4a630e tempest-SnapshotDependencyTests-866830756 None] Created volume successfully.
Apr 29 10:47:00 devstack sudo[111669]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14" returned: 0 in 0.787s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d21c59b-4f75-4176-b37d-436960a8664b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:00 devstack sudo[111685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f
Apr 29 10:47:00 devstack sudo[111685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:00 devstack sudo[111673]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896" returned: 0 in 0.813s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:00 devstack sudo[111687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896
Apr 29 10:47:00 devstack sudo[111687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:01 devstack sudo[111687]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:01 devstack sudo[111678]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-45bc8ecf-dd54-4f4e-aeec-254d80ba5896" returned: 0 in 0.696s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-87994e7f-83a4-49e9-8778-93cad013fbf4 1073741824" returned: 0 in 1.005s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-45bc8ecf-dd54-4f4e-aeec-254d80ba5896" released by "delete_volume" :: held 1.568s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:01 devstack sudo[111685]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f" returned: 0 in 0.877s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-87994e7f-83a4-49e9-8778-93cad013fbf4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:01 devstack sudo[111697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14
Apr 29 10:47:01 devstack sudo[111697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:01 devstack sudo[111698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-87994e7f-83a4-49e9-8778-93cad013fbf4
Apr 29 10:47:01 devstack sudo[111698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Created reservations ['d37cd7f8-1e91-4b8f-97d7-5fa5fb5d771d', '307af921-0b5c-4fc3-8e65-b1452c5454e1', 'e8de98f9-cccf-4a70-b0bf-815f0b1a48c7', '917cbde3-493a-47ed-b83f-a4e1428dc01b'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:01 devstack sudo[111701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:01 devstack sudo[111701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "cinder-84f40c57-d051-45b2-b892-281438c118db-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-84f40c57-d051-45b2-b892-281438c118db-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "cinder-quobyte-84f40c57-d051-45b2-b892-281438c118db" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-84f40c57-d051-45b2-b892-281438c118db" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d7bd88-1cfe-45ec-bf19-16bddd410026]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84f40c57-d051-45b2-b892-281438c118db {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:01 devstack sudo[111698]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-87994e7f-83a4-49e9-8778-93cad013fbf4" returned: 0 in 0.656s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.711s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] Creating offline snapshot 4ce6d55d-3965-4ad0-bb5f-7060a4a23262 of volume 2025592a-d025-4e4e-bd21-22ff5deb2099 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb4da50-6d59-42c2-b17b-639f7c04be09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87994e7f-83a4-49e9-8778-93cad013fbf4', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c3a1bf-b665-473c-b278-33268069f184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6297ca3-d14b-46ad-a590-8c7bc2c9c9e4]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:02 devstack sudo[111707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84f40c57-d051-45b2-b892-281438c118db
Apr 29 10:47:02 devstack sudo[111707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:02 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Volume volume-87994e7f-83a4-49e9-8778-93cad013fbf4 (87994e7f-83a4-49e9-8778-93cad013fbf4): created successfully
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c3a1bf-b665-473c-b278-33268069f184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Flow 'volume_create_manager' (c9206da1-1741-40c2-b3f9-fa07b48d2fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c046e329-c694-452f-bed2-bf51f18bfce7 tempest-CinderUnicodeTest-977470485 None] Created volume successfully.
Apr 29 10:47:02 devstack sudo[111697]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14" returned: 0 in 0.819s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:02 devstack sudo[111711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14
Apr 29 10:47:02 devstack sudo[111711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:02 devstack sudo[111701]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.745s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:47:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Deleted volume successfully.
Apr 29 10:47:02 devstack sudo[111709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099
Apr 29 10:47:02 devstack sudo[111709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-790059cb-b85d-465a-a936-6a9531253e1f tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-45bc8ecf-dd54-4f4e-aeec-254d80ba5896-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:02 devstack sudo[111711]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f.18f8f445-076e-4299-bf0f-c2f1af729b14" returned: 0 in 0.649s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:02 devstack sudo[111707]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-18f8f445-076e-4299-bf0f-c2f1af729b14" released by "_delete_snapshot" :: held 3.268s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84f40c57-d051-45b2-b892-281438c118db" returned: 0 in 0.921s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84f40c57-d051-45b2-b892-281438c118db {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-9d681616-5783-4fba-86a0-02bf5ccdfa4f" released by "delete_snapshot" :: held 3.314s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:02 devstack sudo[111720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84f40c57-d051-45b2-b892-281438c118db
Apr 29 10:47:02 devstack sudo[111720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Flow 'volume_create_manager' (3fbf5658-0b91-41be-b651-4bf5db4e6bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14076370-754f-4f90-a313-09b1b5b7d7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14076370-754f-4f90-a313-09b1b5b7d7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2063319191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e267b55-d57a-4ebe-be87-da756aa74333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d62fe4b3f6149a7bccffe02aefb2f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:03Z,use_quota=True,user_id='cfeed916e9d14faea2e058766a4827da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fc435f-56e1-49c4-8823-61ada988f532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fc435f-56e1-49c4-8823-61ada988f532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153a4fef-701c-49d0-b890-d1b500a04d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153a4fef-701c-49d0-b890-d1b500a04d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e267b55-d57a-4ebe-be87-da756aa74333', 'volume_name': 'volume-3e267b55-d57a-4ebe-be87-da756aa74333', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d098be33-41a0-4e99-8543-e8e1923a4cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d098be33-41a0-4e99-8543-e8e1923a4cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee493701-59f3-414a-b489-c559c8f442bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:02 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Volume 3e267b55-d57a-4ebe-be87-da756aa74333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e267b55-d57a-4ebe-be87-da756aa74333', 'volume_size': 1}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:02 devstack sudo[111709]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099" returned: 0 in 0.979s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:02 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Created reservations ['fc11b600-cf22-4d54-a55b-450769f7b4f9', 'e7fd1647-db1b-4263-8c92-b5fee4872321', '2ca995e9-9087-4690-b8f6-0e14f89ea37a', '34dae243-9884-46a3-b9ff-76d537a835d8'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:03 devstack sudo[111723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262 1G
Apr 29 10:47:03 devstack sudo[111723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:03 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Delete snapshot completed successfully.
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-db03d618-ec3c-4396-a7e5-26e73413b51b tempest-VolumeDependencyTests-363769395 None] Lock "cinder-18f8f445-076e-4299-bf0f-c2f1af729b14-delete_snapshot" released by "delete_snapshot" :: held 3.582s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:03 devstack sudo[111720]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-84f40c57-d051-45b2-b892-281438c118db" returned: 0 in 0.642s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-84f40c57-d051-45b2-b892-281438c118db" released by "delete_volume" :: held 1.605s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Created reservations ['d164293f-04e9-4db4-be0c-f7c285cb592d', 'c4bc1561-413d-4761-a5dc-8746a50fbee3', 'f54dbffd-8fb5-40e8-9c2b-132b5ec0d7c8', 'd21d9ae1-8099-4759-b15d-5b3c2cf94760'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:03 devstack sudo[111729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:03 devstack sudo[111729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Acquiring lock "cinder-9d681616-5783-4fba-86a0-02bf5ccdfa4f-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Lock "cinder-9d681616-5783-4fba-86a0-02bf5ccdfa4f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:03 devstack sudo[111723]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262 1G" returned: 0 in 0.803s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2025592a-d025-4e4e-bd21-22ff5deb2099 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Acquiring lock "cinder-quobyte-9d681616-5783-4fba-86a0-02bf5ccdfa4f" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:03 devstack sudo[111732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2025592a-d025-4e4e-bd21-22ff5deb2099 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262
Apr 29 10:47:03 devstack sudo[111732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-9d681616-5783-4fba-86a0-02bf5ccdfa4f" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2ddde0-b13f-42d8-91c9-6fd521e691cf]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:03 devstack sudo[111734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f
Apr 29 10:47:03 devstack sudo[111734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "cinder-d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "cinder-quobyte-9318ab93-ddfa-49b3-a51e-929bb1b7d553" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-9318ab93-ddfa-49b3-a51e-929bb1b7d553" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "cinder-quobyte-d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Deleting offline snapshot d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4 of volume 9318ab93-ddfa-49b3-a51e-929bb1b7d553 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] snapshot_file for this snap is: volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e13b2c-570c-4fe7-b7dc-00024a4ff4ed]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:04 devstack sudo[111729]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.661s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:47:04 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Deleted volume successfully.
Apr 29 10:47:04 devstack sudo[111738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4
Apr 29 10:47:04 devstack sudo[111738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-a558c84c-08d1-40c2-8ee1-249798188e11 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-84f40c57-d051-45b2-b892-281438c118db-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:04 devstack sudo[111732]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2025592a-d025-4e4e-bd21-22ff5deb2099 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262" returned: 0 in 0.756s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:04 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262 is being set with open permissions: ugo+rw
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:04 devstack sudo[111743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262
Apr 29 10:47:04 devstack sudo[111743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:04 devstack sudo[111734]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f" returned: 0 in 0.873s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:04 devstack sudo[111748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f
Apr 29 10:47:04 devstack sudo[111748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:04 devstack sudo[111738]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4" returned: 0 in 0.823s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90caecb-dfe4-4a37-a420-2f67f03d37c9]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:05 devstack sudo[111753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553
Apr 29 10:47:05 devstack sudo[111753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:05 devstack sudo[111743]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262" returned: 0 in 0.651s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:05 devstack sudo[111756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.info
Apr 29 10:47:05 devstack sudo[111756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:05 devstack sudo[111748]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9d681616-5783-4fba-86a0-02bf5ccdfa4f" returned: 0 in 0.689s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-9d681616-5783-4fba-86a0-02bf5ccdfa4f" released by "delete_volume" :: held 1.625s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Created reservations ['09958664-fbd8-4f58-b30d-fb9598cdb7c0', '87f75c81-9325-4f7e-8256-61b2e5e3f56c', '726b67f4-2ab1-48aa-b3cd-b6610412f836', 'a741417e-d75d-4747-8c46-e06103b260b9'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:05 devstack sudo[111759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:05 devstack sudo[111759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:05 devstack sudo[111761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:05 devstack sudo[111761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:05 devstack sudo[111753]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553" returned: 0 in 0.761s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:05 devstack sudo[111766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4
Apr 29 10:47:05 devstack sudo[111766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:05 devstack sudo[111756]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.info" returned: 0 in 0.734s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:05 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.info is being set with open permissions: ugo+rw
Apr 29 10:47:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:06 devstack sudo[111769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.info
Apr 29 10:47:06 devstack sudo[111769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:06 devstack sudo[111759]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.673s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:47:06 devstack sudo[111761]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.775s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:47:06 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Deleted volume successfully.
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-dc20f7df-1e76-4672-b10e-dc2d8ef15b8a tempest-VolumeDependencyTests-363769395 None] Lock "cinder-9d681616-5783-4fba-86a0-02bf5ccdfa4f-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:47:06 devstack sudo[111766]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Flow 'volume_create_manager' (17cf6d34-8e05-413a-94f8-981038a5a31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ea4246-5c2c-4ea0-881b-9bd937fa8390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4" returned: 0 in 0.856s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ea4246-5c2c-4ea0-881b-9bd937fa8390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1179706379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d397d3-e85c-4927-a84d-bb5d761f89c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25600ed3628e4baaa820e52c3aa5b6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:07Z,use_quota=True,user_id='70fbba391b4448ad8ea95918d5379d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:06 devstack sudo[111777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4
Apr 29 10:47:06 devstack sudo[111777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199a5eac-a9d6-4f11-ac5d-5f90eb2e4150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199a5eac-a9d6-4f11-ac5d-5f90eb2e4150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c496c573-4130-42f0-9135-f8fd0cb6f386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c496c573-4130-42f0-9135-f8fd0cb6f386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d397d3-e85c-4927-a84d-bb5d761f89c6', 'volume_name': 'volume-63d397d3-e85c-4927-a84d-bb5d761f89c6', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562999fc-5f9a-4311-b1ff-568d94285b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562999fc-5f9a-4311-b1ff-568d94285b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70fe0ee-03b2-4850-9f0a-5367a179d6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:06 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Volume 63d397d3-e85c-4927-a84d-bb5d761f89c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d397d3-e85c-4927-a84d-bb5d761f89c6', 'volume_size': 1}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:06 devstack sudo[111769]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.info" returned: 0 in 0.807s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.849s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.851s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2063319191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e267b55-d57a-4ebe-be87-da756aa74333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d62fe4b3f6149a7bccffe02aefb2f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:03Z,use_quota=True,user_id='cfeed916e9d14faea2e058766a4827da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Creating volume 3e267b55-d57a-4ebe-be87-da756aa74333 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:47:06 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:47:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:06 devstack sudo[111780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333 1073741824
Apr 29 10:47:06 devstack sudo[111780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:06 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3ed65ded-fe6a-43d9-9d19-65ef76d25eb4 tempest-SnapshotDependencyTests-866830756 None] Create snapshot completed successfully
Apr 29 10:47:07 devstack sudo[111777]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553.d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4" returned: 0 in 0.650s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:07 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4" released by "_delete_snapshot" :: held 3.201s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:07 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-9318ab93-ddfa-49b3-a51e-929bb1b7d553" released by "delete_snapshot" :: held 3.228s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:07 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Created reservations ['0206da41-439c-4c7f-878e-5e8e6c95aa0a', 'd52db863-3904-40ad-a401-de8afd1fd607', 'e7acec18-5493-4f61-ac48-1cfc6b85e90d', 'ce738ca4-77b6-4bbc-a529-3a552df4c9ff'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:07 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Delete snapshot completed successfully.
Apr 29 10:47:07 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-64f9320c-1911-4757-933e-144026c62db0 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-d753cdf3-c93b-47c3-ae5f-bc2e85b63ef4-delete_snapshot" released by "delete_snapshot" :: held 3.384s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:07 devstack sudo[111780]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333 1073741824" returned: 0 in 0.854s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:07 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:07 devstack sudo[111787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333
Apr 29 10:47:07 devstack sudo[111787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Flow 'volume_create_manager' (6c671420-609e-4f19-a66c-921cf5835a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2805d1d0-09d5-4b7c-ae3f-7bd55d789f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2805d1d0-09d5-4b7c-ae3f-7bd55d789f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5871824d-0414-4634-b301-92a369eb914a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e777a23d733e488d9a3f16605b7ac297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4ce6d55d-3965-4ad0-bb5f-7060a4a23262,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:08Z,use_quota=True,user_id='ff39c0860d9c47aa8550c18786b560fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71241021-a4a0-49b2-adf5-db0d74d8aa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71241021-a4a0-49b2-adf5-db0d74d8aa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5baa8e16-d6cd-4e7e-bbd7-b9c511574f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5baa8e16-d6cd-4e7e-bbd7-b9c511574f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5871824d-0414-4634-b301-92a369eb914a', 'volume_name': 'volume-5871824d-0414-4634-b301-92a369eb914a', 'volume_size': 1, 'snapshot_id': '4ce6d55d-3965-4ad0-bb5f-7060a4a23262'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440201de-70e1-49a0-8305-da8dc510b184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440201de-70e1-49a0-8305-da8dc510b184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cb5cd2-d2b3-46d1-90f4-86a578722923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:08 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Volume 5871824d-0414-4634-b301-92a369eb914a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5871824d-0414-4634-b301-92a369eb914a', 'volume_size': 1, 'snapshot_id': '4ce6d55d-3965-4ad0-bb5f-7060a4a23262'}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "cinder-9318ab93-ddfa-49b3-a51e-929bb1b7d553-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-9318ab93-ddfa-49b3-a51e-929bb1b7d553-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:08 devstack sudo[111787]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333" returned: 0 in 0.613s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.646s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1179706379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d397d3-e85c-4927-a84d-bb5d761f89c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25600ed3628e4baaa820e52c3aa5b6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:07Z,use_quota=True,user_id='70fbba391b4448ad8ea95918d5379d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Creating volume 63d397d3-e85c-4927-a84d-bb5d761f89c6 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:47:08 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:08 devstack sudo[111790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 1073741824
Apr 29 10:47:08 devstack sudo[111790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee493701-59f3-414a-b489-c559c8f442bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e267b55-d57a-4ebe-be87-da756aa74333', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683b2ea8-3598-47df-8646-4676c2f7fe74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "cinder-quobyte-9318ab93-ddfa-49b3-a51e-929bb1b7d553" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:08 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Volume volume-3e267b55-d57a-4ebe-be87-da756aa74333 (3e267b55-d57a-4ebe-be87-da756aa74333): created successfully
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683b2ea8-3598-47df-8646-4676c2f7fe74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Flow 'volume_create_manager' (3fbf5658-0b91-41be-b651-4bf5db4e6bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-9318ab93-ddfa-49b3-a51e-929bb1b7d553" acquired by "delete_volume" :: waited 0.031s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:08 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-87359be5-8af6-499a-b4af-754cde1690fb tempest-CinderUnicodeTest-977470485 None] Created volume successfully.
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dee5fc-d2f7-4ef7-9118-66557f7321ac]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:08 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:08 devstack sudo[111792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553
Apr 29 10:47:08 devstack sudo[111792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:09 devstack sudo[111790]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 1073741824" returned: 0 in 0.833s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:09 devstack sudo[111792]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553" returned: 0 in 0.772s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:09 devstack sudo[111800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6
Apr 29 10:47:09 devstack sudo[111800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:09 devstack sudo[111801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553
Apr 29 10:47:09 devstack sudo[111801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:09 devstack sudo[111800]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6" returned: 0 in 0.652s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.741s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "cinder-quobyte-4ce6d55d-3965-4ad0-bb5f-7060a4a23262-5871824d-0414-4634-b301-92a369eb914a" by "_create_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:09 devstack sudo[111801]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70fe0ee-03b2-4850-9f0a-5367a179d6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d397d3-e85c-4927-a84d-bb5d761f89c6', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcacdc49-b799-4f39-a124-c1677063bf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-quobyte-4ce6d55d-3965-4ad0-bb5f-7060a4a23262-5871824d-0414-4634-b301-92a369eb914a" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Creating volume 5871824d-0414-4634-b301-92a369eb914a from snapshot 4ce6d55d-3965-4ad0-bb5f-7060a4a23262 {{(pid=84165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "cinder-quobyte-5871824d-0414-4634-b301-92a369eb914a" by "_copy_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=111,cinder:UPDATE=168,cinder:INSERT=30,cinder:DELETE=20 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9318ab93-ddfa-49b3-a51e-929bb1b7d553" returned: 0 in 0.687s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:09 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Volume volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 (63d397d3-e85c-4927-a84d-bb5d761f89c6): created successfully
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcacdc49-b799-4f39-a124-c1677063bf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Flow 'volume_create_manager' (17cf6d34-8e05-413a-94f8-981038a5a31e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-quobyte-9318ab93-ddfa-49b3-a51e-929bb1b7d553" released by "delete_volume" :: held 1.547s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-quobyte-5871824d-0414-4634-b301-92a369eb914a" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:09 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] snapshot: 4ce6d55d-3965-4ad0-bb5f-7060a4a23262, volume: 5871824d-0414-4634-b301-92a369eb914a,  {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 10:47:09 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1b1573dd-9dee-495c-bd2a-408b71769d7f tempest-VolumeDependencyTests-363769395 None] Created volume successfully.
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14cd559-3620-46d0-83c7-71c119b7cd09]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Created reservations ['5b426de6-01d8-4d0c-b395-e955bd809881', '1f717832-5d64-4c12-9516-8cf9b81e0a44', 'e598eec4-254b-4158-8468-488b959ea0c7', 'fbb13a1e-f046-4f86-8e1c-afb6d106e76c'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:10 devstack sudo[111806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262
Apr 29 10:47:10 devstack sudo[111806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:10 devstack sudo[111807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:10 devstack sudo[111807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=123,cinder:UPDATE=151,cinder:INSERT=43,cinder:DELETE=11 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:47:10 devstack sudo[111807]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.655s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:47:10 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Deleted volume successfully.
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7165d090-0ded-4083-a87f-3385fd76e568 tempest-CreateVolumesFromSnapshotTest-1362458789 None] Lock "cinder-9318ab93-ddfa-49b3-a51e-929bb1b7d553-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:10 devstack sudo[111806]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262" returned: 0 in 0.820s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2025592a-d025-4e4e-bd21-22ff5deb2099(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099 {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Creating direct copy from snapshot {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab4b313-94b9-4af3-a072-10ff3cc765a5]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:10 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:10 devstack sudo[111815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099
Apr 29 10:47:10 devstack sudo[111815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:11 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:47:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Flow 'volume_create_manager' (c6cf479d-4940-418c-a907-7974465e1217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2943d66-1ec9-4f3b-8049-2ce230f29a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2943d66-1ec9-4f3b-8049-2ce230f29a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-676988094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4fdc61-5785-41a5-9a6f-48e38a9973f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25600ed3628e4baaa820e52c3aa5b6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=63d397d3-e85c-4927-a84d-bb5d761f89c6,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:11Z,use_quota=True,user_id='70fbba391b4448ad8ea95918d5379d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da239fc-4588-4862-9afa-e00b2046c001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da239fc-4588-4862-9afa-e00b2046c001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359dc247-f0a5-42ad-9ddd-56a4d1db476e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359dc247-f0a5-42ad-9ddd-56a4d1db476e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cf4fdc61-5785-41a5-9a6f-48e38a9973f6', 'volume_name': 'volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6', 'volume_size': 1, 'source_volid': '63d397d3-e85c-4927-a84d-bb5d761f89c6', 'source_volstatus': 'available'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d754dad4-b88a-4bd2-bac6-9e9eb28a6fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d754dad4-b88a-4bd2-bac6-9e9eb28a6fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:11 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80efd90-8d57-41a2-a818-483fe03b4fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:11 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Volume cf4fdc61-5785-41a5-9a6f-48e38a9973f6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6', 'volume_size': 1, 'source_volid': '63d397d3-e85c-4927-a84d-bb5d761f89c6', 'source_volstatus': 'available'}
Apr 29 10:47:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:11 devstack sudo[111815]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099" returned: 0 in 0.862s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:11 devstack cinder-volume[84165]: DEBUG cinder.utils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Path /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5871824d-0414-4634-b301-92a369eb914a not found in is_blk_device check {{(pid=84165) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 10:47:11 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5871824d-0414-4634-b301-92a369eb914a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:11 devstack sudo[111820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5871824d-0414-4634-b301-92a369eb914a
Apr 29 10:47:11 devstack sudo[111820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:15 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:47:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Flow 'volume_create_manager' (f79284f2-52b2-4ec4-ba61-3d5df86da2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772a9afe-e994-433a-959f-41b1724ccbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772a9afe-e994-433a-959f-41b1724ccbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-786924487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad3100e-88e8-4df6-8016-1d63a56001e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34615c25118a403ca7fc753ce2a2d898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:15Z,use_quota=True,user_id='2b6414a199cd416180d8d615a4e8c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32718d1c-db7d-4139-9954-89ace94e536f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32718d1c-db7d-4139-9954-89ace94e536f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998eb957-c85b-464a-a89a-d18501ae252a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998eb957-c85b-464a-a89a-d18501ae252a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad3100e-88e8-4df6-8016-1d63a56001e5', 'volume_name': 'volume-9ad3100e-88e8-4df6-8016-1d63a56001e5', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2399be2-36bb-4269-852c-3f8c5f32b7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2399be2-36bb-4269-852c-3f8c5f32b7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:15 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4a774c-193f-4e47-a4e3-40d0a7313ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:15 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume 9ad3100e-88e8-4df6-8016-1d63a56001e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad3100e-88e8-4df6-8016-1d63a56001e5', 'volume_size': 1}
Apr 29 10:47:15 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:16 devstack sudo[111820]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5871824d-0414-4634-b301-92a369eb914a" returned: 0 in 5.194s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:16 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeca29ca-2496-4825-8336-9e21316b0bd5]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:16 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:17 devstack sudo[111834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099
Apr 29 10:47:17 devstack sudo[111834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:17 devstack sudo[111834]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099" returned: 0 in 0.872s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:17 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5871824d-0414-4634-b301-92a369eb914a {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:47:17 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Converted 1024.00 MB image at 197.13 MB/s
Apr 29 10:47:17 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5871824d-0414-4634-b301-92a369eb914a is being set with open permissions: ugo+rw
Apr 29 10:47:17 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5871824d-0414-4634-b301-92a369eb914a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:17 devstack sudo[111839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5871824d-0414-4634-b301-92a369eb914a
Apr 29 10:47:17 devstack sudo[111839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:18 devstack sudo[111839]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5871824d-0414-4634-b301-92a369eb914a" returned: 0 in 0.563s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-quobyte-5871824d-0414-4634-b301-92a369eb914a" released by "_copy_volume_from_snapshot" :: held 8.429s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:18 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-quobyte-4ce6d55d-3965-4ad0-bb5f-7060a4a23262-5871824d-0414-4634-b301-92a369eb914a" released by "_create_volume_from_snapshot" :: held 8.496s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.530s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.919s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:18 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] Creating offline snapshot 2dd4b5b3-aedd-467b-b0f3-430c9206383d of volume 3e267b55-d57a-4ebe-be87-da756aa74333 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:47:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cb5cd2-d2b3-46d1-90f4-86a578722923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5871824d-0414-4634-b301-92a369eb914a', 'volume_size': 1, 'snapshot_id': '4ce6d55d-3965-4ad0-bb5f-7060a4a23262'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ac700b-0a90-4c3e-9d8e-8c5919c22e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:18 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd905087-0a78-4eee-976e-f699f094da9d]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:18 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:18 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Volume volume-5871824d-0414-4634-b301-92a369eb914a (5871824d-0414-4634-b301-92a369eb914a): created successfully
Apr 29 10:47:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ac700b-0a90-4c3e-9d8e-8c5919c22e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:18 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Flow 'volume_create_manager' (6c671420-609e-4f19-a66c-921cf5835a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:18 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-ff9f570c-31d7-437d-9ac5-66350c30f945 tempest-SnapshotDependencyTests-866830756 None] Created volume successfully.
Apr 29 10:47:18 devstack sudo[111842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333
Apr 29 10:47:18 devstack sudo[111842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "cinder-4ce6d55d-3965-4ad0-bb5f-7060a4a23262-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-4ce6d55d-3965-4ad0-bb5f-7060a4a23262-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "cinder-quobyte-2025592a-d025-4e4e-bd21-22ff5deb2099" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-quobyte-2025592a-d025-4e4e-bd21-22ff5deb2099" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "cinder-quobyte-4ce6d55d-3965-4ad0-bb5f-7060a4a23262" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-quobyte-4ce6d55d-3965-4ad0-bb5f-7060a4a23262" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Deleting offline snapshot 4ce6d55d-3965-4ad0-bb5f-7060a4a23262 of volume 2025592a-d025-4e4e-bd21-22ff5deb2099 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] snapshot_file for this snap is: volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:47:19 devstack sudo[111842]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333" returned: 0 in 0.750s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5d4a41-1e8a-42fa-997a-e26d5eaea057]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:19 devstack sudo[111847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d 1G
Apr 29 10:47:19 devstack sudo[111847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:19 devstack sudo[111848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262
Apr 29 10:47:19 devstack sudo[111848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:19 devstack sudo[111847]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d 1G" returned: 0 in 0.740s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e267b55-d57a-4ebe-be87-da756aa74333 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:19 devstack sudo[111848]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262" returned: 0 in 0.744s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2025592a-d025-4e4e-bd21-22ff5deb2099(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:47:19 devstack sudo[111858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e267b55-d57a-4ebe-be87-da756aa74333 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d
Apr 29 10:47:19 devstack sudo[111858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[942b3599-566f-4736-9d64-5b8df73e4922]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:19 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:20 devstack sudo[111860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099
Apr 29 10:47:20 devstack sudo[111860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:20 devstack sudo[111858]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e267b55-d57a-4ebe-be87-da756aa74333 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d" returned: 0 in 0.703s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:20 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d is being set with open permissions: ugo+rw
Apr 29 10:47:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:20 devstack sudo[111868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d
Apr 29 10:47:20 devstack sudo[111868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:20 devstack sudo[111860]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099" returned: 0 in 0.761s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:20 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:20 devstack sudo[111870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262
Apr 29 10:47:20 devstack sudo[111870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:21 devstack sudo[111868]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d" returned: 0 in 0.635s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:21 devstack sudo[111876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.info
Apr 29 10:47:21 devstack sudo[111876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:21 devstack sudo[111870]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262" returned: 0 in 0.724s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:21 devstack sudo[111878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262
Apr 29 10:47:21 devstack sudo[111878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:21 devstack sudo[111876]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.info" returned: 0 in 0.637s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:21 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.info is being set with open permissions: ugo+rw
Apr 29 10:47:21 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:21 devstack sudo[111882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.info
Apr 29 10:47:21 devstack sudo[111882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:22 devstack sudo[111878]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099.4ce6d55d-3965-4ad0-bb5f-7060a4a23262" returned: 0 in 0.616s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-quobyte-4ce6d55d-3965-4ad0-bb5f-7060a4a23262" released by "_delete_snapshot" :: held 2.961s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-quobyte-2025592a-d025-4e4e-bd21-22ff5deb2099" released by "delete_snapshot" :: held 2.990s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Created reservations ['6e8e8ef8-bc0b-40e4-9fd4-86d52b685945', '90f1bac5-8900-4f76-823a-6f1b236c88c1', '2201c691-29c1-4d2a-a4c4-e772caf580a2', 'a89076dc-1f82-4631-8196-cda29ab81e15'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:22 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Delete snapshot completed successfully.
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-7d37526c-11c9-4b40-b8de-43a30ec262ea tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-4ce6d55d-3965-4ad0-bb5f-7060a4a23262-delete_snapshot" released by "delete_snapshot" :: held 3.148s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "cinder-2025592a-d025-4e4e-bd21-22ff5deb2099-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-2025592a-d025-4e4e-bd21-22ff5deb2099-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "cinder-quobyte-2025592a-d025-4e4e-bd21-22ff5deb2099" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-quobyte-2025592a-d025-4e4e-bd21-22ff5deb2099" acquired by "delete_volume" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72ac41b-281d-4585-8971-4a5e8c73bf2b]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:22 devstack sudo[111885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099
Apr 29 10:47:22 devstack sudo[111885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:22 devstack sudo[111882]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.info" returned: 0 in 0.656s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.230s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 11.035s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:22 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Cloning volume 63d397d3-e85c-4927-a84d-bb5d761f89c6 to volume cf4fdc61-5785-41a5-9a6f-48e38a9973f6
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Creating offline snapshot 18b8f53e-b32e-4343-9e46-38dc7ef9d58d of volume 63d397d3-e85c-4927-a84d-bb5d761f89c6 {{(pid=84165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 10:47:22 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-2d653b27-eae4-4c2d-81df-1b4695350ae5 tempest-CinderUnicodeTest-977470485 None] Create snapshot completed successfully
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecbced2-dac3-4616-8553-d94c1aaed572]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:22 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:22 devstack sudo[111888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6
Apr 29 10:47:22 devstack sudo[111888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:23 devstack sudo[111885]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099" returned: 0 in 0.757s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:23 devstack sudo[111899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099
Apr 29 10:47:23 devstack sudo[111899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Acquiring lock "cinder-2dd4b5b3-aedd-467b-b0f3-430c9206383d-delete_snapshot" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Lock "cinder-2dd4b5b3-aedd-467b-b0f3-430c9206383d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Acquiring lock "cinder-quobyte-3e267b55-d57a-4ebe-be87-da756aa74333" by "delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Lock "cinder-quobyte-3e267b55-d57a-4ebe-be87-da756aa74333" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Acquiring lock "cinder-quobyte-2dd4b5b3-aedd-467b-b0f3-430c9206383d" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Lock "cinder-quobyte-2dd4b5b3-aedd-467b-b0f3-430c9206383d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Deleting offline snapshot 2dd4b5b3-aedd-467b-b0f3-430c9206383d of volume 3e267b55-d57a-4ebe-be87-da756aa74333 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:47:23 devstack sudo[111888]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] snapshot_file for this snap is: volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6" returned: 0 in 0.814s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d 1G {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd509206-5a6f-4234-861b-f8743c4935c6]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:23 devstack sudo[111904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d 1G
Apr 29 10:47:23 devstack sudo[111904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:23 devstack sudo[111905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d
Apr 29 10:47:23 devstack sudo[111905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:23 devstack sudo[111899]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-2025592a-d025-4e4e-bd21-22ff5deb2099" returned: 0 in 0.667s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-quobyte-2025592a-d025-4e4e-bd21-22ff5deb2099" released by "delete_volume" :: held 1.490s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:23 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Created reservations ['0d9f7065-d61a-4996-a8dc-9f929004d10b', '48ff91f3-c2f7-4d40-b34a-f8d9347d79f6', '25872a57-feb4-4c59-a226-cc52373aa7c9', 'ef7c13e2-3c58-4472-8f29-4c1a9d69f187'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:24 devstack sudo[111911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:24 devstack sudo[111911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:24 devstack sudo[111904]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d 1G" returned: 0 in 0.823s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:24 devstack sudo[111905]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d" returned: 0 in 0.824s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e267b55-d57a-4ebe-be87-da756aa74333(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:47:24 devstack sudo[111919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d
Apr 29 10:47:24 devstack sudo[111919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4195773f-4bfd-43b7-b0d3-683df4588c66]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:24 devstack sudo[111921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333
Apr 29 10:47:24 devstack sudo[111921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "cinder-5871824d-0414-4634-b301-92a369eb914a-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-5871824d-0414-4634-b301-92a369eb914a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "cinder-quobyte-5871824d-0414-4634-b301-92a369eb914a" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:24 devstack sudo[111911]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.714s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-quobyte-5871824d-0414-4634-b301-92a369eb914a" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:24 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Deleted volume successfully.
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e29c0bb-bb54-4b94-8ba5-cfc3844e519c]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5871824d-0414-4634-b301-92a369eb914a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:24 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-02819c0f-f5af-4297-862f-6ca6af78d041 tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-2025592a-d025-4e4e-bd21-22ff5deb2099-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:24 devstack sudo[111924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5871824d-0414-4634-b301-92a369eb914a
Apr 29 10:47:24 devstack sudo[111924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:25 devstack sudo[111919]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 -F qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d" returned: 0 in 0.781s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:25 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d is being set with open permissions: ugo+rw
Apr 29 10:47:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:25 devstack sudo[111929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d
Apr 29 10:47:25 devstack sudo[111929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:25 devstack sudo[111921]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333" returned: 0 in 0.989s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:25 devstack sudo[111934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d
Apr 29 10:47:25 devstack sudo[111934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:25 devstack sudo[111924]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5871824d-0414-4634-b301-92a369eb914a" returned: 0 in 0.837s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5871824d-0414-4634-b301-92a369eb914a {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:25 devstack sudo[111939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5871824d-0414-4634-b301-92a369eb914a
Apr 29 10:47:25 devstack sudo[111939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:25 devstack sudo[111929]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d" returned: 0 in 0.667s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:25 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:25 devstack sudo[111942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.info
Apr 29 10:47:25 devstack sudo[111942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:26 devstack sudo[111934]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d" returned: 0 in 0.753s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:26 devstack sudo[111947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d
Apr 29 10:47:26 devstack sudo[111947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:26 devstack sudo[111939]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5871824d-0414-4634-b301-92a369eb914a" returned: 0 in 0.664s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-quobyte-5871824d-0414-4634-b301-92a369eb914a" released by "delete_volume" :: held 1.564s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Created reservations ['b73b5506-791a-4d4c-a05e-777d54fefe88', 'fcca93c3-5cc5-4197-b6f4-dfea46ffe487', '20690b27-66f0-4327-b237-310f3df0adf1', 'a04f528c-7265-4500-82fd-66ed98237409'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:26 devstack sudo[111951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:26 devstack sudo[111951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:26 devstack sudo[111942]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.info" returned: 0 in 0.709s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:26 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.info is being set with open permissions: ugo+rw
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.info {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:26 devstack sudo[111953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.info
Apr 29 10:47:26 devstack sudo[111953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:26 devstack sudo[111947]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333.2dd4b5b3-aedd-467b-b0f3-430c9206383d" returned: 0 in 0.661s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Lock "cinder-quobyte-2dd4b5b3-aedd-467b-b0f3-430c9206383d" released by "_delete_snapshot" :: held 3.370s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Lock "cinder-quobyte-3e267b55-d57a-4ebe-be87-da756aa74333" released by "delete_snapshot" :: held 3.397s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:26 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Created reservations ['5b441c18-8bec-40ad-be96-c8ff9e3dc795', '7446ea9e-04e6-49cd-844b-d5c8a54196eb', '0acf8a63-6bbc-4aa5-98cc-565bbbfa1924', '545e2fd5-aef4-4e9e-be06-2e8991335210'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:27 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Delete snapshot completed successfully.
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1285aac1-9a29-4b6b-b64d-b47ffeff68b7 tempest-CinderUnicodeTest-977470485 None] Lock "cinder-2dd4b5b3-aedd-467b-b0f3-430c9206383d-delete_snapshot" released by "delete_snapshot" :: held 3.600s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:27 devstack sudo[111951]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.735s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:47:27 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Deleted volume successfully.
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0071b2f7-1733-4a43-ba18-af4bbdc1892d tempest-SnapshotDependencyTests-866830756 None] Lock "cinder-5871824d-0414-4634-b301-92a369eb914a-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:27 devstack sudo[111953]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.info" returned: 0 in 0.721s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Acquiring lock "cinder-quobyte-cf4fdc61-5785-41a5-9a6f-48e38a9973f6" by "_copy_volume_from_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-cf4fdc61-5785-41a5-9a6f-48e38a9973f6" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] snapshot: 18b8f53e-b32e-4343-9e46-38dc7ef9d58d, volume: cf4fdc61-5785-41a5-9a6f-48e38a9973f6,  {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0906fc35-f0fb-4cc3-a31e-58a36bd82979]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:27 devstack sudo[111960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d
Apr 29 10:47:27 devstack sudo[111960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Acquiring lock "cinder-3e267b55-d57a-4ebe-be87-da756aa74333-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Lock "cinder-3e267b55-d57a-4ebe-be87-da756aa74333-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Acquiring lock "cinder-quobyte-3e267b55-d57a-4ebe-be87-da756aa74333" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Lock "cinder-quobyte-3e267b55-d57a-4ebe-be87-da756aa74333" acquired by "delete_volume" :: waited 0.031s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[65233757-8970-4ec6-afe2-6f9de3b97c0c]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:27 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:27 devstack sudo[111963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333
Apr 29 10:47:27 devstack sudo[111963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:28 devstack sudo[111960]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d" returned: 0 in 0.845s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63d397d3-e85c-4927-a84d-bb5d761f89c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:47:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 10:47:28 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Creating direct copy from snapshot {{(pid=84165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 10:47:28 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1974d1-a4f2-434c-b1c5-e12eb47f2779]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:28 devstack sudo[111968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6
Apr 29 10:47:28 devstack sudo[111968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:28 devstack sudo[111963]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333" returned: 0 in 0.788s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:28 devstack sudo[111974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333
Apr 29 10:47:28 devstack sudo[111974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:28 devstack sudo[111968]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6" returned: 0 in 0.785s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:28 devstack cinder-volume[84165]: DEBUG cinder.utils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Path /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6 not found in is_blk_device check {{(pid=84165) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 10:47:28 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:29 devstack sudo[111979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6
Apr 29 10:47:29 devstack sudo[111979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:29 devstack sudo[111974]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3e267b55-d57a-4ebe-be87-da756aa74333" returned: 0 in 0.651s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:29 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Lock "cinder-quobyte-3e267b55-d57a-4ebe-be87-da756aa74333" released by "delete_volume" :: held 1.511s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:29 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Created reservations ['5e45f6a0-29f2-4520-a68e-fbda8a2c331c', '7208d678-c945-4f72-99e5-ef37982662da', '52d8df36-4224-4a17-94ae-d63162d065ee', '4c1cd2c1-2c48-4c48-8464-778e0ec57fd1'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:29 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:29 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:29 devstack sudo[111982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:29 devstack sudo[111982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Acquiring lock "cinder-87994e7f-83a4-49e9-8778-93cad013fbf4-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Lock "cinder-87994e7f-83a4-49e9-8778-93cad013fbf4-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Acquiring lock "cinder-quobyte-87994e7f-83a4-49e9-8778-93cad013fbf4" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:30 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Lock "cinder-quobyte-87994e7f-83a4-49e9-8778-93cad013fbf4" acquired by "delete_volume" :: waited 0.055s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:30 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dcbaf5-70dd-490c-8037-d321b6d2e409]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:30 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-87994e7f-83a4-49e9-8778-93cad013fbf4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:30 devstack sudo[111995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-87994e7f-83a4-49e9-8778-93cad013fbf4
Apr 29 10:47:30 devstack sudo[111995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:31 devstack sudo[111982]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:31 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 1.743s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:31 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:47:31 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Deleted volume successfully.
Apr 29 10:47:31 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-5a766158-6127-4851-a5d9-75387978a4df tempest-CinderUnicodeTest-977470485 None] Lock "cinder-3e267b55-d57a-4ebe-be87-da756aa74333-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:33 devstack sudo[111995]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-87994e7f-83a4-49e9-8778-93cad013fbf4" returned: 0 in 2.635s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:33 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-87994e7f-83a4-49e9-8778-93cad013fbf4 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:33 devstack sudo[112037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-87994e7f-83a4-49e9-8778-93cad013fbf4
Apr 29 10:47:33 devstack sudo[112037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:34 devstack sudo[112037]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:34 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-87994e7f-83a4-49e9-8778-93cad013fbf4" returned: 0 in 1.577s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:34 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Lock "cinder-quobyte-87994e7f-83a4-49e9-8778-93cad013fbf4" released by "delete_volume" :: held 4.315s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:34 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Created reservations ['1298cdb5-f1a1-4f5c-b6e2-762cebc8bcdc', '17a3f45e-6cd0-4055-8d51-24284738fa4e', '44a23cf8-21de-4a92-992c-35a80b6f0648', '30a65997-4a96-4398-89a8-441b84135ccc'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:35 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:35 devstack sudo[112042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:35 devstack sudo[112042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:35 devstack sudo[111979]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6" returned: 0 in 6.276s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:35 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d6bf1f-b959-46f3-900d-e80dc20e0545]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:35 devstack sudo[112044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6
Apr 29 10:47:35 devstack sudo[112044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:35 devstack sudo[112042]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:35 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.695s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:35 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:47:35 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Deleted volume successfully.
Apr 29 10:47:35 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-1c725e51-4205-448f-a45e-b06b1d8f9c55 tempest-CinderUnicodeTest-977470485 None] Lock "cinder-87994e7f-83a4-49e9-8778-93cad013fbf4-delete_volume" released by "delete_volume" :: held 5.566s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:36 devstack sudo[112044]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6" returned: 0 in 1.209s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:36 devstack cinder-volume[84165]: DEBUG cinder.image.image_utils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Image conversion details: src /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6, size 1024.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6 {{(pid=84165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 10:47:36 devstack cinder-volume[84165]: INFO cinder.image.image_utils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Converted 1024.00 MB image at 163.07 MB/s
Apr 29 10:47:36 devstack cinder-volume[84165]: WARNING cinder.volume.drivers.remotefs [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6 is being set with open permissions: ugo+rw
Apr 29 10:47:36 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:36 devstack sudo[112052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6
Apr 29 10:47:36 devstack sudo[112052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:37 devstack sudo[112052]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6" returned: 0 in 0.741s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:37 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-cf4fdc61-5785-41a5-9a6f-48e38a9973f6" released by "_copy_volume_from_snapshot" :: held 9.968s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:37 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Acquiring lock "cinder-quobyte-18b8f53e-b32e-4343-9e46-38dc7ef9d58d" by "_delete_snapshot" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:37 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-18b8f53e-b32e-4343-9e46-38dc7ef9d58d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Deleting offline snapshot 18b8f53e-b32e-4343-9e46-38dc7ef9d58d of volume 63d397d3-e85c-4927-a84d-bb5d761f89c6 {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 10:47:37 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] snapshot_file for this snap is: volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d {{(pid=84165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 10:47:37 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5374b152-d114-46d4-9c53-2f7bc706e97f]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:37 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:37 devstack sudo[112055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d
Apr 29 10:47:37 devstack sudo[112055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:38 devstack sudo[112055]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d" returned: 0 in 0.827s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:38 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63d397d3-e85c-4927-a84d-bb5d761f89c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 10:47:38 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ea6135-1e65-4ddb-8c32-5c6e5deedaff]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:38 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:38 devstack sudo[112061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6
Apr 29 10:47:38 devstack sudo[112061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:39 devstack sudo[112061]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6" returned: 0 in 0.811s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:39 devstack sudo[112067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d
Apr 29 10:47:39 devstack sudo[112067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:39 devstack sudo[112067]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d" returned: 0 in 0.739s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:39 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:39 devstack sudo[112072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d
Apr 29 10:47:39 devstack sudo[112072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:40 devstack sudo[112072]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6.18b8f53e-b32e-4343-9e46-38dc7ef9d58d" returned: 0 in 0.609s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-18b8f53e-b32e-4343-9e46-38dc7ef9d58d" released by "_delete_snapshot" :: held 3.090s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.814s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.997s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-786924487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad3100e-88e8-4df6-8016-1d63a56001e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34615c25118a403ca7fc753ce2a2d898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:15Z,use_quota=True,user_id='2b6414a199cd416180d8d615a4e8c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Creating volume 9ad3100e-88e8-4df6-8016-1d63a56001e5 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:47:40 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9ad3100e-88e8-4df6-8016-1d63a56001e5 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:40 devstack sudo[112075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9ad3100e-88e8-4df6-8016-1d63a56001e5 1073741824
Apr 29 10:47:40 devstack sudo[112075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80efd90-8d57-41a2-a818-483fe03b4fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6', 'volume_size': 1, 'source_volid': '63d397d3-e85c-4927-a84d-bb5d761f89c6', 'source_volstatus': 'available'}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eaf5d2e-26e4-4cf6-baee-2ab08d075673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:40 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Volume volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6 (cf4fdc61-5785-41a5-9a6f-48e38a9973f6): created successfully
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eaf5d2e-26e4-4cf6-baee-2ab08d075673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:40 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Flow 'volume_create_manager' (c6cf479d-4940-418c-a907-7974465e1217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:40 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c194ed6f-2b0f-40a6-9848-e2814e1ec3eb tempest-VolumeDependencyTests-363769395 None] Created volume successfully.
Apr 29 10:47:41 devstack sudo[112075]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9ad3100e-88e8-4df6-8016-1d63a56001e5 1073741824" returned: 0 in 0.751s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9ad3100e-88e8-4df6-8016-1d63a56001e5 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:41 devstack sudo[112080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9ad3100e-88e8-4df6-8016-1d63a56001e5
Apr 29 10:47:41 devstack sudo[112080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Acquiring lock "cinder-63d397d3-e85c-4927-a84d-bb5d761f89c6-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Lock "cinder-63d397d3-e85c-4927-a84d-bb5d761f89c6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Acquiring lock "cinder-quobyte-63d397d3-e85c-4927-a84d-bb5d761f89c6" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:41 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-63d397d3-e85c-4927-a84d-bb5d761f89c6" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:41 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbc577e-6e67-44c6-88ea-cc2f18ca2136]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:41 devstack sudo[112082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6
Apr 29 10:47:41 devstack sudo[112082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:41 devstack sudo[112080]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9ad3100e-88e8-4df6-8016-1d63a56001e5" returned: 0 in 0.596s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:41 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:47:41 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4a774c-193f-4e47-a4e3-40d0a7313ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad3100e-88e8-4df6-8016-1d63a56001e5', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc7f92c-49ac-4f33-8a40-65bce3cf8952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:41 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume volume-9ad3100e-88e8-4df6-8016-1d63a56001e5 (9ad3100e-88e8-4df6-8016-1d63a56001e5): created successfully
Apr 29 10:47:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc7f92c-49ac-4f33-8a40-65bce3cf8952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:41 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Flow 'volume_create_manager' (f79284f2-52b2-4ec4-ba61-3d5df86da2d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:41 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-2e076aeb-4ad0-4680-a776-f68a968679a2 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Created volume successfully.
Apr 29 10:47:42 devstack sudo[112082]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6" returned: 0 in 0.726s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:42 devstack sudo[112088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6
Apr 29 10:47:42 devstack sudo[112088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:42 devstack sudo[112088]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-63d397d3-e85c-4927-a84d-bb5d761f89c6" returned: 0 in 0.602s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:42 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-63d397d3-e85c-4927-a84d-bb5d761f89c6" released by "delete_volume" :: held 1.408s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:42 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Created reservations ['c2ef1ecb-27a7-4870-8de3-3817bbdeaec8', '48fd30f2-48b0-476d-b77a-a0d26d0609e7', 'c0c4a0e1-e5a2-4d8d-8549-67bea9b395e4', '60712f03-77f7-4caa-ae7d-c4f9a681ea4b'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:42 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:43 devstack sudo[112091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:43 devstack sudo[112091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Flow 'volume_create_manager' (b3eb4009-e63d-48b2-86ee-baaf6711364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a28ad82-ffc8-4e71-b34d-e54d57f601eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a28ad82-ffc8-4e71-b34d-e54d57f601eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1849279559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a46dc21-d59f-4f71-b998-9e7735455027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34615c25118a403ca7fc753ce2a2d898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:43Z,use_quota=True,user_id='2b6414a199cd416180d8d615a4e8c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3054abe4-7cfd-4adc-b3b0-d905d107e125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3054abe4-7cfd-4adc-b3b0-d905d107e125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6283b2-8fc6-4308-9ea0-d30a0b4ec6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6283b2-8fc6-4308-9ea0-d30a0b4ec6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a46dc21-d59f-4f71-b998-9e7735455027', 'volume_name': 'volume-3a46dc21-d59f-4f71-b998-9e7735455027', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb4df82-eeee-4d61-ba1a-3ce8cb164206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb4df82-eeee-4d61-ba1a-3ce8cb164206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734d2bce-7529-4356-9937-703a9393873b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:43 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume 3a46dc21-d59f-4f71-b998-9e7735455027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a46dc21-d59f-4f71-b998-9e7735455027', 'volume_size': 1}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1849279559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a46dc21-d59f-4f71-b998-9e7735455027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34615c25118a403ca7fc753ce2a2d898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:43Z,use_quota=True,user_id='2b6414a199cd416180d8d615a4e8c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Creating volume 3a46dc21-d59f-4f71-b998-9e7735455027 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:47:43 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3a46dc21-d59f-4f71-b998-9e7735455027 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:43 devstack sudo[112093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3a46dc21-d59f-4f71-b998-9e7735455027 1073741824
Apr 29 10:47:43 devstack sudo[112093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Flow 'volume_create_manager' (eb413251-6fb3-42d1-9d6b-289acb41c6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a784ad1-b8f2-47c5-b201-76951f958fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a784ad1-b8f2-47c5-b201-76951f958fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1474446573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677d6a06-5552-49b1-820c-f0ae94352ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34615c25118a403ca7fc753ce2a2d898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:43Z,use_quota=True,user_id='2b6414a199cd416180d8d615a4e8c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fac36fd-1dbb-4413-9c52-6ee4375d92bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fac36fd-1dbb-4413-9c52-6ee4375d92bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffcb1162-1830-49a6-9a33-f427ccfafff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffcb1162-1830-49a6-9a33-f427ccfafff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '677d6a06-5552-49b1-820c-f0ae94352ad6', 'volume_name': 'volume-677d6a06-5552-49b1-820c-f0ae94352ad6', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f64a549-aaa2-41f1-9680-f736f642c9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f64a549-aaa2-41f1-9680-f736f642c9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f82778-329f-43c4-8b7f-ef0e38afd4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:43 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume 677d6a06-5552-49b1-820c-f0ae94352ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-677d6a06-5552-49b1-820c-f0ae94352ad6', 'volume_size': 1}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Acquiring lock "cinder-cf4fdc61-5785-41a5-9a6f-48e38a9973f6-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Lock "cinder-cf4fdc61-5785-41a5-9a6f-48e38a9973f6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Acquiring lock "cinder-quobyte-cf4fdc61-5785-41a5-9a6f-48e38a9973f6" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-cf4fdc61-5785-41a5-9a6f-48e38a9973f6" acquired by "delete_volume" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:43 devstack sudo[112091]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.794s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:47:43 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Deleted volume successfully.
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f805ffd-380d-4cad-a25a-427a1b553e1a]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:43 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-444cfb37-4ace-4ad3-b5d3-f9560e42bcab tempest-VolumeDependencyTests-363769395 None] Lock "cinder-63d397d3-e85c-4927-a84d-bb5d761f89c6-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:43 devstack sudo[112096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6
Apr 29 10:47:43 devstack sudo[112096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Flow 'volume_create_manager' (333c1cb9-62f2-428e-b83e-3aed2de277ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a39dbc5-8aed-4655-8436-150a654afae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a39dbc5-8aed-4655-8436-150a654afae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-856685617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e304a7d-c06a-446b-82df-dfd73273d8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34615c25118a403ca7fc753ce2a2d898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:44Z,use_quota=True,user_id='2b6414a199cd416180d8d615a4e8c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed9fb08-7e33-4277-89a7-6bede8eba7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed9fb08-7e33-4277-89a7-6bede8eba7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2c1a60-7386-4161-919d-6e5c796b92ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2c1a60-7386-4161-919d-6e5c796b92ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e304a7d-c06a-446b-82df-dfd73273d8f3', 'volume_name': 'volume-5e304a7d-c06a-446b-82df-dfd73273d8f3', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988b966b-38f7-4d18-8e52-0265bda15a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988b966b-38f7-4d18-8e52-0265bda15a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2dae2b-37c2-4256-b9d6-e8b29f98f27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:44 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume 5e304a7d-c06a-446b-82df-dfd73273d8f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e304a7d-c06a-446b-82df-dfd73273d8f3', 'volume_size': 1}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:44 devstack sudo[112093]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3a46dc21-d59f-4f71-b998-9e7735455027 1073741824" returned: 0 in 1.146s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3a46dc21-d59f-4f71-b998-9e7735455027 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:44 devstack sudo[112104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3a46dc21-d59f-4f71-b998-9e7735455027
Apr 29 10:47:44 devstack sudo[112104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Flow 'volume_create_manager' (af2874cf-c26d-4091-a506-846a073f4a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d384eaf-1ec3-4dca-9118-a97b3e3b7751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d384eaf-1ec3-4dca-9118-a97b3e3b7751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-514859308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf1ba11-9e27-422c-a340-30400615f759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34615c25118a403ca7fc753ce2a2d898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:44Z,use_quota=True,user_id='2b6414a199cd416180d8d615a4e8c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce61cbf0-ae48-42b0-995a-8ab6c13bac6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce61cbf0-ae48-42b0-995a-8ab6c13bac6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8de77f1-c5df-486b-bd7f-ca3396b2f036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8de77f1-c5df-486b-bd7f-ca3396b2f036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf1ba11-9e27-422c-a340-30400615f759', 'volume_name': 'volume-fdf1ba11-9e27-422c-a340-30400615f759', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77fcec5-7b58-4224-9bbf-249cd7181186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77fcec5-7b58-4224-9bbf-249cd7181186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a4abd8-bf3c-461b-ba4d-8e8fafbc9350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:44 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume fdf1ba11-9e27-422c-a340-30400615f759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf1ba11-9e27-422c-a340-30400615f759', 'volume_size': 1}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:44 devstack sudo[112096]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6" returned: 0 in 0.833s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:44 devstack sudo[112109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6
Apr 29 10:47:44 devstack sudo[112109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Flow 'volume_create_manager' (1b2b1e87-216d-4ab3-990a-d2e88a4c2bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81b290f-37ae-423e-b059-82795b13e770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81b290f-37ae-423e-b059-82795b13e770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2058689208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319a875f-49e0-4b96-9694-f6635a126555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34615c25118a403ca7fc753ce2a2d898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:45Z,use_quota=True,user_id='2b6414a199cd416180d8d615a4e8c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b930d5a-da4a-4936-a1b5-287f88d1b6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b930d5a-da4a-4936-a1b5-287f88d1b6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d73e2b-c16b-4fdb-a95b-7393c72c6ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d73e2b-c16b-4fdb-a95b-7393c72c6ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '319a875f-49e0-4b96-9694-f6635a126555', 'volume_name': 'volume-319a875f-49e0-4b96-9694-f6635a126555', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0723dc-77e7-479f-8b0a-00949f769bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0723dc-77e7-479f-8b0a-00949f769bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec2a182-e977-4be8-bff8-7db6975c8923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:44 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume 319a875f-49e0-4b96-9694-f6635a126555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-319a875f-49e0-4b96-9694-f6635a126555', 'volume_size': 1}
Apr 29 10:47:44 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:45 devstack sudo[112104]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3a46dc21-d59f-4f71-b998-9e7735455027" returned: 0 in 0.683s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.469s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1474446573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677d6a06-5552-49b1-820c-f0ae94352ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34615c25118a403ca7fc753ce2a2d898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:43Z,use_quota=True,user_id='2b6414a199cd416180d8d615a4e8c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Creating volume 677d6a06-5552-49b1-820c-f0ae94352ad6 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:47:45 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-677d6a06-5552-49b1-820c-f0ae94352ad6 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:45 devstack sudo[112112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-677d6a06-5552-49b1-820c-f0ae94352ad6 1073741824
Apr 29 10:47:45 devstack sudo[112112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734d2bce-7529-4356-9937-703a9393873b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a46dc21-d59f-4f71-b998-9e7735455027', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f01b728-c104-4aaf-a2f4-d1008d7c60d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:45 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume volume-3a46dc21-d59f-4f71-b998-9e7735455027 (3a46dc21-d59f-4f71-b998-9e7735455027): created successfully
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f01b728-c104-4aaf-a2f4-d1008d7c60d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Flow 'volume_create_manager' (b3eb4009-e63d-48b2-86ee-baaf6711364f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:45 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0bdc8c47-f774-4a84-9353-224f8d5148c8 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Created volume successfully.
Apr 29 10:47:45 devstack sudo[112109]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-cf4fdc61-5785-41a5-9a6f-48e38a9973f6" returned: 0 in 0.663s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-cf4fdc61-5785-41a5-9a6f-48e38a9973f6" released by "delete_volume" :: held 1.553s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Created reservations ['23a8f937-ada4-4a99-9a1d-15c388bb92ee', '50e83ace-0db9-437b-819f-a01057c3204d', '7d05a776-a6c4-4fa9-835f-8df9c968786f', 'b7d48b2e-99a6-465a-8a70-a42ab5d22996'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:45 devstack sudo[112115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:45 devstack sudo[112115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:45 devstack sudo[112112]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-677d6a06-5552-49b1-820c-f0ae94352ad6 1073741824" returned: 0 in 0.820s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:45 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-677d6a06-5552-49b1-820c-f0ae94352ad6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:45 devstack sudo[112120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-677d6a06-5552-49b1-820c-f0ae94352ad6
Apr 29 10:47:45 devstack sudo[112120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Acquiring lock "cinder-4f9026af-ee71-4783-a20b-7711d39c3b05-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Lock "cinder-4f9026af-ee71-4783-a20b-7711d39c3b05-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:46 devstack sudo[112115]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.664s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Acquiring lock "cinder-quobyte-4f9026af-ee71-4783-a20b-7711d39c3b05" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:46 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Deleted volume successfully.
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-4f9026af-ee71-4783-a20b-7711d39c3b05" acquired by "delete_volume" :: waited 0.022s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-c7cb8a98-5d4e-4bba-8c57-dfae60dfff14 tempest-VolumeDependencyTests-363769395 None] Lock "cinder-cf4fdc61-5785-41a5-9a6f-48e38a9973f6-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cea5676-0069-433f-b66d-b7a570c58a1f]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4f9026af-ee71-4783-a20b-7711d39c3b05 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:46 devstack sudo[112123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4f9026af-ee71-4783-a20b-7711d39c3b05
Apr 29 10:47:46 devstack sudo[112123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:46 devstack sudo[112120]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-677d6a06-5552-49b1-820c-f0ae94352ad6" returned: 0 in 0.707s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.521s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-856685617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e304a7d-c06a-446b-82df-dfd73273d8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34615c25118a403ca7fc753ce2a2d898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:44Z,use_quota=True,user_id='2b6414a199cd416180d8d615a4e8c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Creating volume 5e304a7d-c06a-446b-82df-dfd73273d8f3 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:47:46 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5e304a7d-c06a-446b-82df-dfd73273d8f3 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:46 devstack sudo[112126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5e304a7d-c06a-446b-82df-dfd73273d8f3 1073741824
Apr 29 10:47:46 devstack sudo[112126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f82778-329f-43c4-8b7f-ef0e38afd4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-677d6a06-5552-49b1-820c-f0ae94352ad6', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d205e4f5-3c71-468f-a453-2517b0767393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:46 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume volume-677d6a06-5552-49b1-820c-f0ae94352ad6 (677d6a06-5552-49b1-820c-f0ae94352ad6): created successfully
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d205e4f5-3c71-468f-a453-2517b0767393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Flow 'volume_create_manager' (eb413251-6fb3-42d1-9d6b-289acb41c6ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:46 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-5418760a-4fb8-4c87-84c3-b5a3cbc27205 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Created volume successfully.
Apr 29 10:47:46 devstack sudo[112123]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4f9026af-ee71-4783-a20b-7711d39c3b05" returned: 0 in 0.790s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:46 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4f9026af-ee71-4783-a20b-7711d39c3b05 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:46 devstack sudo[112131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4f9026af-ee71-4783-a20b-7711d39c3b05
Apr 29 10:47:46 devstack sudo[112131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:47 devstack sudo[112126]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5e304a7d-c06a-446b-82df-dfd73273d8f3 1073741824" returned: 0 in 0.806s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5e304a7d-c06a-446b-82df-dfd73273d8f3 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:47 devstack sudo[112137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5e304a7d-c06a-446b-82df-dfd73273d8f3
Apr 29 10:47:47 devstack sudo[112137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:47 devstack sudo[112131]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-4f9026af-ee71-4783-a20b-7711d39c3b05" returned: 0 in 0.643s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:47 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Lock "cinder-quobyte-4f9026af-ee71-4783-a20b-7711d39c3b05" released by "delete_volume" :: held 1.475s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:47 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Created reservations ['c3e465cf-df45-4a27-995a-c07014b74af1', 'ba496c13-fc3f-4114-8d37-01293754ae75', 'e5645911-3cf2-4fc5-82d0-14342d90fe03', '43464041-8b20-4618-82b1-44aaca94bd15'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:47 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:47 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:47 devstack sudo[112139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:47 devstack sudo[112139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:48 devstack sudo[112137]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5e304a7d-c06a-446b-82df-dfd73273d8f3" returned: 0 in 0.606s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.576s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-514859308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf1ba11-9e27-422c-a340-30400615f759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34615c25118a403ca7fc753ce2a2d898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:44Z,use_quota=True,user_id='2b6414a199cd416180d8d615a4e8c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Creating volume fdf1ba11-9e27-422c-a340-30400615f759 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:47:48 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fdf1ba11-9e27-422c-a340-30400615f759 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:48 devstack sudo[112142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fdf1ba11-9e27-422c-a340-30400615f759 1073741824
Apr 29 10:47:48 devstack sudo[112142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2dae2b-37c2-4256-b9d6-e8b29f98f27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e304a7d-c06a-446b-82df-dfd73273d8f3', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a770bbd-5ab6-4e8e-a907-8aba70de0908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:48 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume volume-5e304a7d-c06a-446b-82df-dfd73273d8f3 (5e304a7d-c06a-446b-82df-dfd73273d8f3): created successfully
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a770bbd-5ab6-4e8e-a907-8aba70de0908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Flow 'volume_create_manager' (333c1cb9-62f2-428e-b83e-3aed2de277ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:48 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-fd3f388c-d53b-4f12-9ab4-fe60f1fb23dc tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Created volume successfully.
Apr 29 10:47:48 devstack sudo[112139]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.639s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:47:48 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Deleted volume successfully.
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-14019500-737f-4bcb-ad91-38640fdd29d2 tempest-VolumeDependencyTests-363769395 None] Lock "cinder-4f9026af-ee71-4783-a20b-7711d39c3b05-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:48 devstack sudo[112142]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fdf1ba11-9e27-422c-a340-30400615f759 1073741824" returned: 0 in 0.792s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:48 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fdf1ba11-9e27-422c-a340-30400615f759 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:48 devstack sudo[112149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fdf1ba11-9e27-422c-a340-30400615f759
Apr 29 10:47:48 devstack sudo[112149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:49 devstack sudo[112149]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fdf1ba11-9e27-422c-a340-30400615f759" returned: 0 in 0.631s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.787s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f525157cc80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T08:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2058689208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319a875f-49e0-4b96-9694-f6635a126555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34615c25118a403ca7fc753ce2a2d898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:47:45Z,use_quota=True,user_id='2b6414a199cd416180d8d615a4e8c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f409e36f-38f0-469c-8132-8f82de0582a1),volume_type_id=f409e36f-38f0-469c-8132-8f82de0582a1)}" {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.remotefs [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Creating volume 319a875f-49e0-4b96-9694-f6635a126555 {{(pid=84165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Selected osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c as target Quobyte volume. {{(pid=84165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 10:47:49 devstack cinder-volume[84165]: INFO cinder.volume.drivers.remotefs [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] casted to osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-319a875f-49e0-4b96-9694-f6635a126555 1073741824 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:49 devstack sudo[112152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-319a875f-49e0-4b96-9694-f6635a126555 1073741824
Apr 29 10:47:49 devstack sudo[112152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a4abd8-bf3c-461b-ba4d-8e8fafbc9350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf1ba11-9e27-422c-a340-30400615f759', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9106b42f-6498-4a9a-9091-74cd8ac03c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:49 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume volume-fdf1ba11-9e27-422c-a340-30400615f759 (fdf1ba11-9e27-422c-a340-30400615f759): created successfully
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9106b42f-6498-4a9a-9091-74cd8ac03c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:49 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Flow 'volume_create_manager' (af2874cf-c26d-4091-a506-846a073f4a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:49 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-ff69656b-dc6f-42ff-8c43-9f61d17fb923 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Created volume successfully.
Apr 29 10:47:50 devstack sudo[112152]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-319a875f-49e0-4b96-9694-f6635a126555 1073741824" returned: 0 in 0.767s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-319a875f-49e0-4b96-9694-f6635a126555 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:50 devstack sudo[112158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-319a875f-49e0-4b96-9694-f6635a126555
Apr 29 10:47:50 devstack sudo[112158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:50 devstack sudo[112158]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-319a875f-49e0-4b96-9694-f6635a126555" returned: 0 in 0.589s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:50 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'} {{(pid=84165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 10:47:50 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec2a182-e977-4be8-bff8-7db6975c8923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319a875f-49e0-4b96-9694-f6635a126555', 'volume_size': 1}' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a6206f0-d855-427c-b6c3-095738e589b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 10:47:51 devstack cinder-volume[84165]: INFO cinder.volume.flows.manager.create_volume [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Volume volume-319a875f-49e0-4b96-9694-f6635a126555 (319a875f-49e0-4b96-9694-f6635a126555): created successfully
Apr 29 10:47:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a6206f0-d855-427c-b6c3-095738e589b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 10:47:51 devstack cinder-volume[84165]: DEBUG cinder.volume.manager [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Flow 'volume_create_manager' (1b2b1e87-216d-4ab3-990a-d2e88a4c2bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 10:47:51 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e57c9524-b2c0-4171-882f-77700d5786d9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Created volume successfully.
Apr 29 10:47:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "cinder-319a875f-49e0-4b96-9694-f6635a126555-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-319a875f-49e0-4b96-9694-f6635a126555-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "cinder-quobyte-319a875f-49e0-4b96-9694-f6635a126555" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:51 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-quobyte-319a875f-49e0-4b96-9694-f6635a126555" acquired by "delete_volume" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:51 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[601bbc67-25b9-4d51-b51c-8cb98e54b4e0]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:51 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-319a875f-49e0-4b96-9694-f6635a126555 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:51 devstack sudo[112161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-319a875f-49e0-4b96-9694-f6635a126555
Apr 29 10:47:51 devstack sudo[112161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:52 devstack sudo[112161]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-319a875f-49e0-4b96-9694-f6635a126555" returned: 0 in 0.672s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-319a875f-49e0-4b96-9694-f6635a126555 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:52 devstack sudo[112166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-319a875f-49e0-4b96-9694-f6635a126555
Apr 29 10:47:52 devstack sudo[112166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:52 devstack sudo[112166]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-319a875f-49e0-4b96-9694-f6635a126555" returned: 0 in 0.552s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:52 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-quobyte-319a875f-49e0-4b96-9694-f6635a126555" released by "delete_volume" :: held 1.265s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:52 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Created reservations ['1f0d86f9-22f4-4c74-bf17-59d699d23252', 'fe93cf98-e44d-4e94-b175-d8c349ef1f78', '2076a818-5db6-4d40-8957-467e3dc38e9b', '762e2a07-8f79-41a9-8ca0-c254c2c0ba2c'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:52 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:52 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:52 devstack sudo[112169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:52 devstack sudo[112169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:53 devstack sudo[112169]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.567s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:53 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:47:53 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Deleted volume successfully.
Apr 29 10:47:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0ee4ecb7-f34c-48ac-bb2e-13fc2ac21e59 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-319a875f-49e0-4b96-9694-f6635a126555-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "cinder-fdf1ba11-9e27-422c-a340-30400615f759-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-fdf1ba11-9e27-422c-a340-30400615f759-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "cinder-quobyte-fdf1ba11-9e27-422c-a340-30400615f759" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:53 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-quobyte-fdf1ba11-9e27-422c-a340-30400615f759" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:53 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5307b88-6c52-4156-93ad-a6254d559001]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:53 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fdf1ba11-9e27-422c-a340-30400615f759 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:53 devstack sudo[112172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fdf1ba11-9e27-422c-a340-30400615f759
Apr 29 10:47:53 devstack sudo[112172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:54 devstack sudo[112172]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fdf1ba11-9e27-422c-a340-30400615f759" returned: 0 in 0.731s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:54 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fdf1ba11-9e27-422c-a340-30400615f759 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:54 devstack sudo[112178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fdf1ba11-9e27-422c-a340-30400615f759
Apr 29 10:47:54 devstack sudo[112178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:55 devstack sudo[112178]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-fdf1ba11-9e27-422c-a340-30400615f759" returned: 0 in 0.598s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-quobyte-fdf1ba11-9e27-422c-a340-30400615f759" released by "delete_volume" :: held 1.365s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Created reservations ['fa41b8f8-5741-443c-8907-0694f1ae8b02', 'ffe2d1a2-da87-480d-bd1b-b00cf6b68941', '93196b4e-4ffc-4f26-abb1-adb0a5cd001c', 'cc1f0c02-22c5-44d5-9526-d2a116cfb1e4'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:55 devstack sudo[112181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:55 devstack sudo[112181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:55 devstack sudo[112181]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.617s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:47:55 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Deleted volume successfully.
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-3f2a27fb-e182-4418-a1eb-091b36055e32 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-fdf1ba11-9e27-422c-a340-30400615f759-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "cinder-5e304a7d-c06a-446b-82df-dfd73273d8f3-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-5e304a7d-c06a-446b-82df-dfd73273d8f3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "cinder-quobyte-5e304a7d-c06a-446b-82df-dfd73273d8f3" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-quobyte-5e304a7d-c06a-446b-82df-dfd73273d8f3" acquired by "delete_volume" :: waited 0.016s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6081c0-6708-46f4-be70-76380e150ba4]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:55 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5e304a7d-c06a-446b-82df-dfd73273d8f3 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:56 devstack sudo[112184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5e304a7d-c06a-446b-82df-dfd73273d8f3
Apr 29 10:47:56 devstack sudo[112184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:56 devstack sudo[112184]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5e304a7d-c06a-446b-82df-dfd73273d8f3" returned: 0 in 0.716s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:56 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5e304a7d-c06a-446b-82df-dfd73273d8f3 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:56 devstack sudo[112190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5e304a7d-c06a-446b-82df-dfd73273d8f3
Apr 29 10:47:56 devstack sudo[112190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:57 devstack sudo[112190]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-5e304a7d-c06a-446b-82df-dfd73273d8f3" returned: 0 in 0.629s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:57 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-quobyte-5e304a7d-c06a-446b-82df-dfd73273d8f3" released by "delete_volume" :: held 1.384s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:57 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Created reservations ['99b5f278-9f4c-4ee1-8f23-8e434b911854', '0ab3aa9a-fdbd-4229-92b2-9021fa22d49f', 'aea0f9a0-b8fe-412d-ad85-32d392322a96', 'b9b62292-ac29-4d07-a5de-9c6144027765'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:57 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:57 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:57 devstack sudo[112193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:57 devstack sudo[112193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:58 devstack sudo[112193]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.605s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:58 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:47:58 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Deleted volume successfully.
Apr 29 10:47:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e3331e25-dfde-4e39-b8d4-1eefc5f1bef9 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-5e304a7d-c06a-446b-82df-dfd73273d8f3-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "cinder-677d6a06-5552-49b1-820c-f0ae94352ad6-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-677d6a06-5552-49b1-820c-f0ae94352ad6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "cinder-quobyte-677d6a06-5552-49b1-820c-f0ae94352ad6" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:47:58 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-quobyte-677d6a06-5552-49b1-820c-f0ae94352ad6" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:47:58 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e02c93e-7ab5-4bec-8ebd-47b423c8e3c0]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:47:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-677d6a06-5552-49b1-820c-f0ae94352ad6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:58 devstack sudo[112196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-677d6a06-5552-49b1-820c-f0ae94352ad6
Apr 29 10:47:58 devstack sudo[112196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:58 devstack sudo[112196]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-677d6a06-5552-49b1-820c-f0ae94352ad6" returned: 0 in 0.723s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:58 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-677d6a06-5552-49b1-820c-f0ae94352ad6 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:58 devstack sudo[112201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-677d6a06-5552-49b1-820c-f0ae94352ad6
Apr 29 10:47:58 devstack sudo[112201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:47:59 devstack sudo[112201]: pam_unix(sudo:session): session closed for user root
Apr 29 10:47:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-677d6a06-5552-49b1-820c-f0ae94352ad6" returned: 0 in 0.569s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:47:59 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-quobyte-677d6a06-5552-49b1-820c-f0ae94352ad6" released by "delete_volume" :: held 1.333s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:47:59 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Created reservations ['7f9c526c-5b3f-4dfd-8ea4-4dc994842bf4', '1e58275f-f5fd-4c7f-aa96-e37f3f7d8b1f', 'cdc508c8-4deb-45da-b77a-6d934dd9c32c', '1a901de8-49ff-48b2-83d8-2a3a3244329f'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:47:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:47:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:47:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:47:59 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:47:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:47:59 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:47:59 devstack sudo[112204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:47:59 devstack sudo[112204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:48:00 devstack sudo[112204]: pam_unix(sudo:session): session closed for user root
Apr 29 10:48:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.603s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:48:00 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:48:00 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Deleted volume successfully.
Apr 29 10:48:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-324b02d2-3f36-4b30-8328-eb3fe4b1c45d tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-677d6a06-5552-49b1-820c-f0ae94352ad6-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:48:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "cinder-3a46dc21-d59f-4f71-b998-9e7735455027-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:48:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-3a46dc21-d59f-4f71-b998-9e7735455027-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:48:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "cinder-quobyte-3a46dc21-d59f-4f71-b998-9e7735455027" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:48:00 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-quobyte-3a46dc21-d59f-4f71-b998-9e7735455027" acquired by "delete_volume" :: waited 0.013s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:48:00 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73adad3-a2ff-4db4-92e9-67ede492fef5]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:48:00 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3a46dc21-d59f-4f71-b998-9e7735455027 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:48:00 devstack sudo[112207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3a46dc21-d59f-4f71-b998-9e7735455027
Apr 29 10:48:00 devstack sudo[112207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:48:01 devstack sudo[112207]: pam_unix(sudo:session): session closed for user root
Apr 29 10:48:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3a46dc21-d59f-4f71-b998-9e7735455027" returned: 0 in 0.698s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:48:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3a46dc21-d59f-4f71-b998-9e7735455027 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:48:01 devstack sudo[112212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3a46dc21-d59f-4f71-b998-9e7735455027
Apr 29 10:48:01 devstack sudo[112212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:48:01 devstack sudo[112212]: pam_unix(sudo:session): session closed for user root
Apr 29 10:48:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-3a46dc21-d59f-4f71-b998-9e7735455027" returned: 0 in 0.598s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:48:01 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-quobyte-3a46dc21-d59f-4f71-b998-9e7735455027" released by "delete_volume" :: held 1.337s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:48:01 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Created reservations ['e4a25646-0119-4df9-ac9c-b4d05650f7ef', 'a0c2dbd6-1145-4e6e-aab5-128843fb54b3', '431d548c-d6b5-4981-9c34-e765295f3262', '28dd2740-b403-44f8-b9e1-f9da55b27288'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:48:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:48:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:48:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:48:01 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:48:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:48:01 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:48:01 devstack sudo[112215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:48:01 devstack sudo[112215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:48:02 devstack sudo[112215]: pam_unix(sudo:session): session closed for user root
Apr 29 10:48:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.605s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:48:02 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:48:02 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Deleted volume successfully.
Apr 29 10:48:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-0fa4857c-ca59-4d8a-ada9-46da5247fd2f tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-3a46dc21-d59f-4f71-b998-9e7735455027-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:48:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "cinder-9ad3100e-88e8-4df6-8016-1d63a56001e5-delete_volume" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:48:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-9ad3100e-88e8-4df6-8016-1d63a56001e5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:48:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "cinder-quobyte-9ad3100e-88e8-4df6-8016-1d63a56001e5" by "delete_volume" {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 10:48:02 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-quobyte-9ad3100e-88e8-4df6-8016-1d63a56001e5" acquired by "delete_volume" :: waited 0.015s {{(pid=84165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 10:48:02 devstack cinder-volume[84165]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ba0fd6-04dc-4b68-a7f5-4a47ef26a6bd]: (4, 'qcow2') {{(pid=84703) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 10:48:02 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9ad3100e-88e8-4df6-8016-1d63a56001e5 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:48:02 devstack sudo[112218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9ad3100e-88e8-4df6-8016-1d63a56001e5
Apr 29 10:48:02 devstack sudo[112218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:48:03 devstack sudo[112218]: pam_unix(sudo:session): session closed for user root
Apr 29 10:48:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9ad3100e-88e8-4df6-8016-1d63a56001e5" returned: 0 in 0.697s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:48:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9ad3100e-88e8-4df6-8016-1d63a56001e5 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:48:03 devstack sudo[112223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9ad3100e-88e8-4df6-8016-1d63a56001e5
Apr 29 10:48:03 devstack sudo[112223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:48:03 devstack sudo[112223]: pam_unix(sudo:session): session closed for user root
Apr 29 10:48:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438/volume-9ad3100e-88e8-4df6-8016-1d63a56001e5" returned: 0 in 0.582s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:48:03 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-quobyte-9ad3100e-88e8-4df6-8016-1d63a56001e5" released by "delete_volume" :: held 1.318s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:48:03 devstack cinder-volume[84165]: DEBUG cinder.quota [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Created reservations ['55f2ae06-fa6c-4cc4-89d3-3cb0596d804e', 'f6dbd77d-117a-4ef3-b6d0-28db73283128', '2d875874-473b-45c7-b521-e1c81c09531a', 'b50e8ee2-3ba2-4c84-a143-0b7dedd1a66b'] {{(pid=84165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 10:48:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:48:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:48:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:48:03 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:48:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:48:03 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:48:04 devstack sudo[112226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:48:04 devstack sudo[112226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:48:04 devstack sudo[112226]: pam_unix(sudo:session): session closed for user root
Apr 29 10:48:04 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.630s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:48:04 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:48:04 devstack cinder-volume[84165]: INFO cinder.volume.manager [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Deleted volume successfully.
Apr 29 10:48:04 devstack cinder-volume[84165]: DEBUG cinder.coordination [None req-e535f267-0e9a-4482-a1d8-d6b3373b1425 tempest-CreateVolumesFromSourceVolumeTest-1247801925 None] Lock "cinder-9ad3100e-88e8-4df6-8016-1d63a56001e5-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=84165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 10:48:05 devstack cinder-volume[84165]: DEBUG oslo_service.periodic_task [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 10:48:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 10:48:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 10:48:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c': None} {{(pid=84165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 10:48:05 devstack cinder-volume[84165]: DEBUG cinder.volume.drivers.quobyte [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a6a3e9cc-6021-4c9c-a1b7-67ec2736190c'] {{(pid=84165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 10:48:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.lockutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 10:48:05 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438 {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 10:48:05 devstack sudo[112230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438
Apr 29 10:48:05 devstack sudo[112230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 10:48:06 devstack sudo[112230]: pam_unix(sudo:session): session closed for user root
Apr 29 10:48:06 devstack cinder-volume[84165]: DEBUG oslo_concurrency.processutils [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1466009c3f7240f7b4c7eb50695c4438" returned: 0 in 0.640s {{(pid=84165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 10:48:06 devstack cinder-volume[84165]: DEBUG cinder.manager [None req-e2f5decb-d9ca-4878-b7c3-893ca4c880e6 None None] Notifying Schedulers of capabilities ... {{(pid=84165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 10:48:13 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:DELETE=8,cinder:SELECT=89,cinder:UPDATE=152,cinder:INSERT=35 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 10:48:14 devstack cinder-volume[84165]: DEBUG dbcounter [-] [84165] Writing DB stats cinder:SELECT=108,cinder:INSERT=37,cinder:UPDATE=135,cinder:DELETE=15 {{(pid=84165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}